Max level shown:
12024-11-07T22:45:03.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2fc0c197-58f2-494a-9a0d-904e5edcf2a9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22024-11-07T22:45:03.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2fc0c197-58f2-494a-9a0d-904e5edcf2a9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32024-11-07T22:45:03.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2fc0c197-58f2-494a-9a0d-904e5edcf2a9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42024-11-07T22:45:04.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d554fce7-b548-4428-b699-c7032c2c5e67 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52024-11-07T22:45:04.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d554fce7-b548-4428-b699-c7032c2c5e67 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
62024-11-07T22:45:04.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2452 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d554fce7-b548-4428-b699-c7032c2c5e67 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
72024-11-07T22:45:05.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c2789864-8eda-4e29-bbe3-7708dcfc875d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82024-11-07T22:45:05.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c2789864-8eda-4e29-bbe3-7708dcfc875d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
92024-11-07T22:45:05.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c2789864-8eda-4e29-bbe3-7708dcfc875d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
102024-11-07T22:45:06.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b60e4129-b679-467e-aa92-1cc5e16e1991 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112024-11-07T22:45:06.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b60e4129-b679-467e-aa92-1cc5e16e1991 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122024-11-07T22:45:06.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2987 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b60e4129-b679-467e-aa92-1cc5e16e1991 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
132024-11-07T22:45:06.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 886364dd-889c-478c-9869-aa492f4b0eeb roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
142024-11-07T22:45:06.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 886364dd-889c-478c-9869-aa492f4b0eeb resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
152024-11-07T22:45:06.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 886364dd-889c-478c-9869-aa492f4b0eeb response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
162024-11-07T22:45:06.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 108e8295-d7d0-4dab-b6eb-241e82eaa6a8 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
172024-11-07T22:45:06.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 108e8295-d7d0-4dab-b6eb-241e82eaa6a8 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
182024-11-07T22:45:06.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 108e8295-d7d0-4dab-b6eb-241e82eaa6a8 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
192024-11-07T22:45:07.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a9dfce6c-b2b5-4678-957c-47f8e60cc47f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
202024-11-07T22:45:07.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a9dfce6c-b2b5-4678-957c-47f8e60cc47f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
212024-11-07T22:45:07.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a9dfce6c-b2b5-4678-957c-47f8e60cc47f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
222024-11-07T22:45:08.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 06941572-4285-4c05-8564-5f21f20c5b7f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
232024-11-07T22:45:08.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 06941572-4285-4c05-8564-5f21f20c5b7f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
242024-11-07T22:45:08.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 06941572-4285-4c05-8564-5f21f20c5b7f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
252024-11-07T22:45:09.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 512dd49c-b811-4156-95c3-1dd3fae663c8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
262024-11-07T22:45:09.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 512dd49c-b811-4156-95c3-1dd3fae663c8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
272024-11-07T22:45:09.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3436 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 512dd49c-b811-4156-95c3-1dd3fae663c8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
282024-11-07T22:45:10.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d59d2571-6cb7-4cd4-942f-f09ee1e3b864 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
292024-11-07T22:45:10.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d59d2571-6cb7-4cd4-942f-f09ee1e3b864 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
302024-11-07T22:45:10.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d59d2571-6cb7-4cd4-942f-f09ee1e3b864 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
312024-11-07T22:45:10.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
322024-11-07T22:45:10.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
332024-11-07T22:45:10.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
342024-11-07T22:45:10.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
352024-11-07T22:45:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
362024-11-07T22:45:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
372024-11-07T22:45:10.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
382024-11-07T22:45:10.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
392024-11-07T22:45:10.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
402024-11-07T22:45:10.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.991588ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
412024-11-07T22:45:10.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
422024-11-07T22:45:10.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
432024-11-07T22:45:10.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
442024-11-07T22:45:10.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
452024-11-07T22:45:10.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
462024-11-07T22:45:10.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
472024-11-07T22:45:10.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
482024-11-07T22:45:10.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
492024-11-07T22:45:10.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
502024-11-07T22:45:10.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
512024-11-07T22:45:10.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.691019ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
522024-11-07T22:45:11.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5b51a51d-35bd-4d1c-aaae-70842effdd37 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
532024-11-07T22:45:11.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5b51a51d-35bd-4d1c-aaae-70842effdd37 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
542024-11-07T22:45:11.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2625 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5b51a51d-35bd-4d1c-aaae-70842effdd37 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
552024-11-07T22:45:12.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e0b525a0-f129-44bd-8a1f-157673c13e90 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
562024-11-07T22:45:12.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e0b525a0-f129-44bd-8a1f-157673c13e90 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
572024-11-07T22:45:12.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2769 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e0b525a0-f129-44bd-8a1f-157673c13e90 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
582024-11-07T22:45:13.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = df24f6c1-165f-49b5-ba03-ebf16f1b3eed roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
592024-11-07T22:45:13.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = df24f6c1-165f-49b5-ba03-ebf16f1b3eed resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
602024-11-07T22:45:13.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2816 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = df24f6c1-165f-49b5-ba03-ebf16f1b3eed response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
612024-11-07T22:45:14.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2e5a9b5d-369f-4853-8261-6a91ed38fd3f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
622024-11-07T22:45:14.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2e5a9b5d-369f-4853-8261-6a91ed38fd3f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
632024-11-07T22:45:14.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1922 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2e5a9b5d-369f-4853-8261-6a91ed38fd3f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
642024-11-07T22:45:15.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6f7f2af9-fcaa-434e-91c5-9bc156a01288 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
652024-11-07T22:45:15.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6f7f2af9-fcaa-434e-91c5-9bc156a01288 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
662024-11-07T22:45:15.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2416 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6f7f2af9-fcaa-434e-91c5-9bc156a01288 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
672024-11-07T22:45:16.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 30d4b080-6f74-4dc0-bed5-c0370924239a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
682024-11-07T22:45:16.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 30d4b080-6f74-4dc0-bed5-c0370924239a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
692024-11-07T22:45:16.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2683 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 30d4b080-6f74-4dc0-bed5-c0370924239a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
702024-11-07T22:45:16.655ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1300 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 76129957-090a-4b11-bc58-19b012362245 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
712024-11-07T22:45:17.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f694a083-c346-4e05-88de-9d913c1c7a4f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
722024-11-07T22:45:17.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f694a083-c346-4e05-88de-9d913c1c7a4f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
732024-11-07T22:45:17.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2886 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f694a083-c346-4e05-88de-9d913c1c7a4f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
742024-11-07T22:45:18.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3572d07e-3c5e-4d38-baab-f25f14be29b0 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
752024-11-07T22:45:18.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3572d07e-3c5e-4d38-baab-f25f14be29b0 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
762024-11-07T22:45:18.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3572d07e-3c5e-4d38-baab-f25f14be29b0 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
772024-11-07T22:45:19.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d6d23f51-882c-4749-be2a-6dc0683882ba roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
782024-11-07T22:45:19.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d6d23f51-882c-4749-be2a-6dc0683882ba resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
792024-11-07T22:45:19.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1619 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d6d23f51-882c-4749-be2a-6dc0683882ba response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
802024-11-07T22:45:20.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5269ae0c-ead5-4bd1-9744-775c10fc113d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
812024-11-07T22:45:20.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5269ae0c-ead5-4bd1-9744-775c10fc113d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
822024-11-07T22:45:20.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5269ae0c-ead5-4bd1-9744-775c10fc113d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
832024-11-07T22:45:20.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
842024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
852024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
862024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
872024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
882024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
892024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
902024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
912024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
922024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
932024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
942024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
952024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
962024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
972024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
982024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
992024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1002024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
1012024-11-07T22:45:20.819ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1022024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
1032024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
1042024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1052024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1062024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1072024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
1082024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1092024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1102024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
1112024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
1122024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1132024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1142024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
1152024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
1162024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1172024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1182024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1192024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1202024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1212024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1222024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1232024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1242024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1252024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1262024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1272024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1282024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1292024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1302024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1312024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1322024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1332024-11-07T22:45:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1342024-11-07T22:45:20.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1352024-11-07T22:45:20.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1362024-11-07T22:45:20.822ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 814, tv_nsec: 911095760 } })
1372024-11-07T22:45:20.822ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
1382024-11-07T22:45:20.824ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.511088ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1392024-11-07T22:45:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1402024-11-07T22:45:20.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1412024-11-07T22:45:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1422024-11-07T22:45:20.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1432024-11-07T22:45:20.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1442024-11-07T22:45:20.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1452024-11-07T22:45:20.826ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1462024-11-07T22:45:20.827ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1472024-11-07T22:45:20.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1482024-11-07T22:45:20.829ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1492024-11-07T22:45:20.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1502024-11-07T22:45:20.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1512024-11-07T22:45:20.829ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1522024-11-07T22:45:20.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1532024-11-07T22:45:20.830ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1542024-11-07T22:45:20.830ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1552024-11-07T22:45:20.830ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1562024-11-07T22:45:20.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1572024-11-07T22:45:20.831ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1582024-11-07T22:45:20.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1592024-11-07T22:45:20.833ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 814, tv_nsec: 921971354 } })
1602024-11-07T22:45:20.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1612024-11-07T22:45:20.833ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1622024-11-07T22:45:20.833ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
1632024-11-07T22:45:20.836ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1642024-11-07T22:45:20.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1652024-11-07T22:45:20.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1662024-11-07T22:45:20.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1672024-11-07T22:45:20.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1682024-11-07T22:45:20.836ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1692024-11-07T22:45:20.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1702024-11-07T22:45:20.836ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1712024-11-07T22:45:20.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1722024-11-07T22:45:20.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1732024-11-07T22:45:20.837ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 814, tv_nsec: 925553880 } })
1742024-11-07T22:45:20.837ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
1752024-11-07T22:45:20.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1762024-11-07T22:45:20.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1772024-11-07T22:45:20.839ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1782024-11-07T22:45:20.841ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1792024-11-07T22:45:20.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1802024-11-07T22:45:20.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1812024-11-07T22:45:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
1822024-11-07T22:45:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1832024-11-07T22:45:20.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1842024-11-07T22:45:20.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1852024-11-07T22:45:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1862024-11-07T22:45:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1872024-11-07T22:45:20.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1882024-11-07T22:45:20.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1892024-11-07T22:45:20.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1902024-11-07T22:45:20.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1912024-11-07T22:45:20.860ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
1922024-11-07T22:45:20.860ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 41.614243ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
1932024-11-07T22:45:20.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.997402ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
1942024-11-07T22:45:20.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.104695ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
1952024-11-07T22:45:20.885ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1962024-11-07T22:45:20.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1972024-11-07T22:45:20.886ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1982024-11-07T22:45:20.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1992024-11-07T22:45:20.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 69.508856ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
2002024-11-07T22:45:20.889ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2012024-11-07T22:45:20.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2022024-11-07T22:45:20.891ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.238599ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2032024-11-07T22:45:20.891ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2042024-11-07T22:45:20.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2052024-11-07T22:45:20.893ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2062024-11-07T22:45:20.893ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 74.409468ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2072024-11-07T22:45:20.893ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2082024-11-07T22:45:20.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.931292ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2092024-11-07T22:45:20.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2102024-11-07T22:45:20.895ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
2112024-11-07T22:45:20.895ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2122024-11-07T22:45:20.895ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "acd785cb-d887-4340-b648-97e49ece7bf6", "content-length": "26", "date": "Thu, 07 Nov 2024 22:45:20 GMT"} })
2132024-11-07T22:45:20.895ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2142024-11-07T22:45:20.896ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2152024-11-07T22:45:20.896ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2162024-11-07T22:45:20.896ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2172024-11-07T22:45:20.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2182024-11-07T22:45:20.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2192024-11-07T22:45:20.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2202024-11-07T22:45:20.897ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2212024-11-07T22:45:20.924ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 104.838349ms iteration = 9 status = {"physical_disks_added":0}
2222024-11-07T22:45:20.925ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
2232024-11-07T22:45:20.925ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2242024-11-07T22:45:20.925ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c08b548-dc0d-4315-882a-a1aeb4b74aac", "content-length": "26", "date": "Thu, 07 Nov 2024 22:45:20 GMT"} })
2252024-11-07T22:45:20.925ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2262024-11-07T22:45:20.928ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
2272024-11-07T22:45:20.939ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2282024-11-07T22:45:20.939ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2292024-11-07T22:45:20.939ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 120.766239ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2302024-11-07T22:45:20.941ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2312024-11-07T22:45:20.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
2322024-11-07T22:45:20.944ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2332024-11-07T22:45:20.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2342024-11-07T22:45:20.948ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 129.084023ms iteration = 6 status = 0
2352024-11-07T22:45:20.953ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 134.784967ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
2362024-11-07T22:45:20.974ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
2372024-11-07T22:45:20.974ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2382024-11-07T22:45:20.975ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "832b8e95-db30-40f1-9d36-fd1eb4d4327a", "content-length": "26", "date": "Thu, 07 Nov 2024 22:45:20 GMT"} })
2392024-11-07T22:45:20.975ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2402024-11-07T22:45:20.978ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2412024-11-07T22:45:21.030ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2422024-11-07T22:45:21.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2432024-11-07T22:45:21.055ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
2442024-11-07T22:45:21.055ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2452024-11-07T22:45:21.056ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "34a830d8-c4c3-4ea9-9dce-70b35dfa6aef", "content-length": "372", "date": "Thu, 07 Nov 2024 22:45:21 GMT"} })
2462024-11-07T22:45:21.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2472024-11-07T22:45:21.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2482024-11-07T22:45:21.061ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 242.613096ms iteration = 6 status = {}
2492024-11-07T22:45:21.075ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
2502024-11-07T22:45:21.075ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2512024-11-07T22:45:21.075ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "58e470c9-28d5-48e6-a56d-87eaf2529d34", "date": "Thu, 07 Nov 2024 22:45:21 GMT"} })
2522024-11-07T22:45:21.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2532024-11-07T22:45:21.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2542024-11-07T22:45:21.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2552024-11-07T22:45:21.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2562024-11-07T22:45:21.082ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
2572024-11-07T22:45:21.082ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6717384-26b0-4627-a819-d438a9ef9d61", "content-length": "1", "date": "Thu, 07 Nov 2024 22:45:20 GMT"} })
2582024-11-07T22:45:21.082ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2592024-11-07T22:45:21.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2602024-11-07T22:45:21.084ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2612024-11-07T22:45:21.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2622024-11-07T22:45:21.086ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 267.470427ms iteration = 6 status = null
2632024-11-07T22:45:21.090ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2642024-11-07T22:45:21.090ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2652024-11-07T22:45:21.090ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4fc0d66b-68ef-48ce-a4e4-bf3860bd65c7", "date": "Thu, 07 Nov 2024 22:45:21 GMT"} })
2662024-11-07T22:45:21.092ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 273.176611ms iteration = 7 status = {}
2672024-11-07T22:45:21.098ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2682024-11-07T22:45:21.101ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2692024-11-07T22:45:21.101ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2702024-11-07T22:45:21.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2712024-11-07T22:45:21.103ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2722024-11-07T22:45:21.105ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2732024-11-07T22:45:21.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2742024-11-07T22:45:21.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2752024-11-07T22:45:21.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2762024-11-07T22:45:21.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2772024-11-07T22:45:21.169ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
2782024-11-07T22:45:21.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2792024-11-07T22:45:21.169ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2802024-11-07T22:45:21.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2812024-11-07T22:45:21.170ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f74b7de-e846-49f0-aae9-6b72ab6538ca", "content-length": "691", "date": "Thu, 07 Nov 2024 22:45:21 GMT"} })
2822024-11-07T22:45:21.170ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
2832024-11-07T22:45:21.170ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
2842024-11-07T22:45:21.170ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
2852024-11-07T22:45:21.172ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 353.055967ms iteration = 6 status = {}
2862024-11-07T22:45:21.180ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2872024-11-07T22:45:21.180ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "63bfc0d6-bfd6-459b-a0a4-fc595fc2a343", "content-length": "134", "date": "Thu, 07 Nov 2024 22:45:20 GMT"} })
2882024-11-07T22:45:21.180ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
2892024-11-07T22:45:21.180ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
2902024-11-07T22:45:21.181ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2912024-11-07T22:45:21.181ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2922024-11-07T22:45:21.181ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2932024-11-07T22:45:21.181ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2942024-11-07T22:45:21.181ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2952024-11-07T22:45:21.181ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2962024-11-07T22:45:21.181ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2972024-11-07T22:45:21.181ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2982024-11-07T22:45:21.181ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
2992024-11-07T22:45:21.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3002024-11-07T22:45:21.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3012024-11-07T22:45:21.184ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
3022024-11-07T22:45:21.185ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "892fe7e1-33b6-4867-a023-d0f3689d248c", "content-length": "2", "date": "Thu, 07 Nov 2024 22:45:20 GMT"} })
3032024-11-07T22:45:21.185ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
3042024-11-07T22:45:21.186ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "04534367-4ec8-47f6-ac68-ecf560529d7a", "content-length": "52", "date": "Thu, 07 Nov 2024 22:45:20 GMT"} })
3052024-11-07T22:45:21.186ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
3062024-11-07T22:45:21.186ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
3072024-11-07T22:45:21.292ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "53111333-b9cc-47fd-873d-e840f01e02a9", "date": "Thu, 07 Nov 2024 22:45:21 GMT"} })
3082024-11-07T22:45:21.292ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
3092024-11-07T22:45:21.292ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
3102024-11-07T22:45:21.293ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d8f106a-61a9-4bbc-9164-8a5ecf843e31", "content-length": "682", "date": "Thu, 07 Nov 2024 22:45:21 GMT"} })
3112024-11-07T22:45:21.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3122024-11-07T22:45:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3132024-11-07T22:45:21.296ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3142024-11-07T22:45:21.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3152024-11-07T22:45:21.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3162024-11-07T22:45:21.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3172024-11-07T22:45:21.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3182024-11-07T22:45:21.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3192024-11-07T22:45:21.319ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 500.091835ms iteration = 6 status = {}
3202024-11-07T22:45:21.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f8671462-f772-490a-b463-83569f28a839 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3212024-11-07T22:45:21.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f8671462-f772-490a-b463-83569f28a839 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3222024-11-07T22:45:21.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2508 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f8671462-f772-490a-b463-83569f28a839 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3232024-11-07T22:45:22.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = e992635c-98c7-4056-9168-f691725f6d7c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
3242024-11-07T22:45:22.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = e992635c-98c7-4056-9168-f691725f6d7c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
3252024-11-07T22:45:22.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 54693fa9-419e-4a95-afc6-b1d6887a5675 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3262024-11-07T22:45:22.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 54693fa9-419e-4a95-afc6-b1d6887a5675 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3272024-11-07T22:45:22.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = e992635c-98c7-4056-9168-f691725f6d7c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
3282024-11-07T22:45:22.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 54693fa9-419e-4a95-afc6-b1d6887a5675 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3292024-11-07T22:45:23.061ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:62943
3302024-11-07T22:45:23.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62943 req_id = 40a8ca14-54f0-42f6-ba96-30d76d4adf74 roles = RoleSet { roles: {} } uri = /metrics/producers
3312024-11-07T22:45:23.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62943 req_id = 40a8ca14-54f0-42f6-ba96-30d76d4adf74 resource = Database result = Ok(()) uri = /metrics/producers
3322024-11-07T22:45:23.107ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3332024-11-07T22:45:23.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46707 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62943 req_id = 40a8ca14-54f0-42f6-ba96-30d76d4adf74 response_code = 201 uri = /metrics/producers
3342024-11-07T22:45:23.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9ac6bbc1-51e0-4cdd-961d-958c154a4657 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3352024-11-07T22:45:23.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9ac6bbc1-51e0-4cdd-961d-958c154a4657 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3362024-11-07T22:45:23.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2693 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9ac6bbc1-51e0-4cdd-961d-958c154a4657 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3372024-11-07T22:45:24.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 436dec39-87fa-4ee0-b15b-5a72cf4b27ff roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3382024-11-07T22:45:24.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 436dec39-87fa-4ee0-b15b-5a72cf4b27ff resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3392024-11-07T22:45:24.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 436dec39-87fa-4ee0-b15b-5a72cf4b27ff response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3402024-11-07T22:45:25.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bb9d1071-e0d4-405c-acff-afe6ab4ee30d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3412024-11-07T22:45:25.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bb9d1071-e0d4-405c-acff-afe6ab4ee30d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3422024-11-07T22:45:25.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2768 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bb9d1071-e0d4-405c-acff-afe6ab4ee30d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3432024-11-07T22:45:26.107ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:33065
3442024-11-07T22:45:26.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33065 req_id = 09542951-6b4a-4199-bcab-8862589c28c1 roles = RoleSet { roles: {} } uri = /metrics/producers
3452024-11-07T22:45:26.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33065 req_id = 09542951-6b4a-4199-bcab-8862589c28c1 resource = Database result = Ok(()) uri = /metrics/producers
3462024-11-07T22:45:26.153ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 9e471274-19dd-4f92-b383-47c4daa65273
3472024-11-07T22:45:26.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45070 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33065 req_id = 09542951-6b4a-4199-bcab-8862589c28c1 response_code = 201 uri = /metrics/producers
3482024-11-07T22:45:26.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 90bf2b5a-4508-401c-8ec1-63a78cebc5c3 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3492024-11-07T22:45:26.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 90bf2b5a-4508-401c-8ec1-63a78cebc5c3 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3502024-11-07T22:45:26.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2916 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 90bf2b5a-4508-401c-8ec1-63a78cebc5c3 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3512024-11-07T22:45:27.444ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:38019
3522024-11-07T22:45:27.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38019 req_id = 832ff00a-a5c3-4873-ad66-d8d7dfc8e0a0 roles = RoleSet { roles: {} } uri = /metrics/producers
3532024-11-07T22:45:27.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38019 req_id = 832ff00a-a5c3-4873-ad66-d8d7dfc8e0a0 resource = Database result = Ok(()) uri = /metrics/producers
3542024-11-07T22:45:27.514ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 815e7211-42cf-4415-8116-29d4376e1760
3552024-11-07T22:45:27.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69991 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38019 req_id = 832ff00a-a5c3-4873-ad66-d8d7dfc8e0a0 response_code = 201 uri = /metrics/producers
3562024-11-07T22:45:27.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6e20b5bf-30e6-4fdb-9b54-a1794ce6573a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3572024-11-07T22:45:27.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6e20b5bf-30e6-4fdb-9b54-a1794ce6573a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3582024-11-07T22:45:27.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6e20b5bf-30e6-4fdb-9b54-a1794ce6573a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3592024-11-07T22:45:28.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = aa9ceefe-2af9-4f97-b464-c67a7a09e70c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3602024-11-07T22:45:28.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = aa9ceefe-2af9-4f97-b464-c67a7a09e70c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3612024-11-07T22:45:28.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = aa9ceefe-2af9-4f97-b464-c67a7a09e70c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3622024-11-07T22:45:29.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 539f4f7f-532d-472a-9ec9-5caaeb155764 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3632024-11-07T22:45:29.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 539f4f7f-532d-472a-9ec9-5caaeb155764 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3642024-11-07T22:45:29.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2586 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 539f4f7f-532d-472a-9ec9-5caaeb155764 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3652024-11-07T22:45:29.826ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:52092
3662024-11-07T22:45:29.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52092 req_id = d2d348ea-4053-4202-93df-edd4e2b206ac roles = RoleSet { roles: {} } uri = /metrics/producers
3672024-11-07T22:45:29.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52092 req_id = d2d348ea-4053-4202-93df-edd4e2b206ac resource = Database result = Ok(()) uri = /metrics/producers
3682024-11-07T22:45:29.876ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 43a27374-6630-4b8d-a3e3-a2857df923bd
3692024-11-07T22:45:29.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50526 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52092 req_id = d2d348ea-4053-4202-93df-edd4e2b206ac response_code = 201 uri = /metrics/producers
3702024-11-07T22:45:30.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 27ad2130-fd07-424b-8dc0-cd0fcd1cd42a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3712024-11-07T22:45:30.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 27ad2130-fd07-424b-8dc0-cd0fcd1cd42a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3722024-11-07T22:45:30.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2843 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 27ad2130-fd07-424b-8dc0-cd0fcd1cd42a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3732024-11-07T22:45:30.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
3742024-11-07T22:45:30.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
3752024-11-07T22:45:30.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3762024-11-07T22:45:30.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3772024-11-07T22:45:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3782024-11-07T22:45:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3792024-11-07T22:45:30.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3802024-11-07T22:45:30.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3812024-11-07T22:45:30.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3822024-11-07T22:45:30.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3832024-11-07T22:45:30.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3842024-11-07T22:45:30.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3852024-11-07T22:45:30.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3862024-11-07T22:45:30.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3872024-11-07T22:45:30.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3882024-11-07T22:45:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
3892024-11-07T22:45:30.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3902024-11-07T22:45:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3912024-11-07T22:45:30.838ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
3922024-11-07T22:45:30.838ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.211169ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
3932024-11-07T22:45:30.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.118997ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3942024-11-07T22:45:31.654ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1710 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = a9d54bef-1dd9-45a0-8c55-ed62b25c9c35 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
3952024-11-07T22:45:31.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 77eecd73-149c-4963-b342-942dbbed9567 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3962024-11-07T22:45:31.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 77eecd73-149c-4963-b342-942dbbed9567 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3972024-11-07T22:45:31.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 77eecd73-149c-4963-b342-942dbbed9567 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3982024-11-07T22:45:32.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3e39d7cc-870e-4968-9d90-dbcbf7dc8e5a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
3992024-11-07T22:45:32.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3e39d7cc-870e-4968-9d90-dbcbf7dc8e5a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4002024-11-07T22:45:32.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2581 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3e39d7cc-870e-4968-9d90-dbcbf7dc8e5a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4012024-11-07T22:45:33.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 99f14d50-ddac-47be-acf2-0bef685e585a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4022024-11-07T22:45:33.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 99f14d50-ddac-47be-acf2-0bef685e585a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4032024-11-07T22:45:33.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 99f14d50-ddac-47be-acf2-0bef685e585a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4042024-11-07T22:45:34.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7d25d7a6-dc21-43a7-afad-63f59b3bc6de roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4052024-11-07T22:45:34.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7d25d7a6-dc21-43a7-afad-63f59b3bc6de resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4062024-11-07T22:45:34.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7d25d7a6-dc21-43a7-afad-63f59b3bc6de response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4072024-11-07T22:45:35.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3f1a580d-47fe-41f7-97ae-e027758ab58b roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4082024-11-07T22:45:35.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3f1a580d-47fe-41f7-97ae-e027758ab58b resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4092024-11-07T22:45:35.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1676 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3f1a580d-47fe-41f7-97ae-e027758ab58b response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4102024-11-07T22:45:36.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 9b10b3c5-607d-4e03-a29e-c2fc60eb7b54 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
4112024-11-07T22:45:36.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 9b10b3c5-607d-4e03-a29e-c2fc60eb7b54 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
4122024-11-07T22:45:36.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 9b10b3c5-607d-4e03-a29e-c2fc60eb7b54 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
4132024-11-07T22:45:36.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = b9e1cc14-9867-48f1-9352-7e1a373813db roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
4142024-11-07T22:45:36.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = b9e1cc14-9867-48f1-9352-7e1a373813db resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
4152024-11-07T22:45:36.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1860 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = b9e1cc14-9867-48f1-9352-7e1a373813db response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
4162024-11-07T22:45:36.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dd3534c5-a881-4997-808a-fa8890728747 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4172024-11-07T22:45:36.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dd3534c5-a881-4997-808a-fa8890728747 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4182024-11-07T22:45:36.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dd3534c5-a881-4997-808a-fa8890728747 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4192024-11-07T22:45:37.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4d0ac4d4-daee-4dac-80b4-568d11cb7a46 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4202024-11-07T22:45:37.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4d0ac4d4-daee-4dac-80b4-568d11cb7a46 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4212024-11-07T22:45:37.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2617 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4d0ac4d4-daee-4dac-80b4-568d11cb7a46 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4222024-11-07T22:45:38.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3c4a79d4-3364-4586-97e5-9bdc2c454083 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4232024-11-07T22:45:38.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3c4a79d4-3364-4586-97e5-9bdc2c454083 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4242024-11-07T22:45:38.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1836 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3c4a79d4-3364-4586-97e5-9bdc2c454083 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4252024-11-07T22:45:39.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ce632bf0-c50f-4c6c-a2c8-ca6e0bb97d42 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4262024-11-07T22:45:39.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ce632bf0-c50f-4c6c-a2c8-ca6e0bb97d42 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4272024-11-07T22:45:39.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ce632bf0-c50f-4c6c-a2c8-ca6e0bb97d42 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4282024-11-07T22:45:40.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
4292024-11-07T22:45:40.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
4302024-11-07T22:45:40.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4312024-11-07T22:45:40.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4322024-11-07T22:45:40.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4332024-11-07T22:45:40.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4342024-11-07T22:45:40.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4352024-11-07T22:45:40.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4362024-11-07T22:45:40.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4372024-11-07T22:45:40.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4382024-11-07T22:45:40.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4392024-11-07T22:45:40.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4402024-11-07T22:45:40.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4412024-11-07T22:45:40.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4422024-11-07T22:45:40.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4432024-11-07T22:45:40.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
4442024-11-07T22:45:40.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4452024-11-07T22:45:40.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4462024-11-07T22:45:40.840ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
4472024-11-07T22:45:40.840ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.37956ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
4482024-11-07T22:45:40.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.166954ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4492024-11-07T22:45:40.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 47815210-2f02-410d-9771-d4c22c02b0dd roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4502024-11-07T22:45:40.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 47815210-2f02-410d-9771-d4c22c02b0dd resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4512024-11-07T22:45:40.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2506 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 47815210-2f02-410d-9771-d4c22c02b0dd response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4522024-11-07T22:45:41.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5e4fbc37-acfa-4bf2-9f67-785f59769934 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4532024-11-07T22:45:41.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5e4fbc37-acfa-4bf2-9f67-785f59769934 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4542024-11-07T22:45:41.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5e4fbc37-acfa-4bf2-9f67-785f59769934 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4552024-11-07T22:45:42.621ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
4562024-11-07T22:45:42.621ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
4572024-11-07T22:45:42.651ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
4582024-11-07T22:45:42.651ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:36752
4592024-11-07T22:45:42.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36752 req_id = 3557b0ba-0f4e-4fc2-bc3f-23be1a40f502 roles = RoleSet { roles: {} } uri = /metrics/producers
4602024-11-07T22:45:42.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36752 req_id = 3557b0ba-0f4e-4fc2-bc3f-23be1a40f502 resource = Database result = Ok(()) uri = /metrics/producers
4612024-11-07T22:45:42.691ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 377e4941-a34d-4c51-b725-3cc833f8df14
4622024-11-07T22:45:42.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40011 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36752 req_id = 3557b0ba-0f4e-4fc2-bc3f-23be1a40f502 response_code = 201 uri = /metrics/producers
4632024-11-07T22:45:42.691ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "3557b0ba-0f4e-4fc2-bc3f-23be1a40f502", "content-length": "41", "date": "Thu, 07 Nov 2024 22:45:42 GMT"} })
4642024-11-07T22:45:42.692ZDEBGnexus (producer-registration-task): registered with nexus successfully
4652024-11-07T22:45:42.692ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
4662024-11-07T22:45:42.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1cb402ed-8278-4e93-8530-ba2a92aa865a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4672024-11-07T22:45:42.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1cb402ed-8278-4e93-8530-ba2a92aa865a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4682024-11-07T22:45:42.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1cb402ed-8278-4e93-8530-ba2a92aa865a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4692024-11-07T22:45:43.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e9eec126-41e5-4ef9-a5db-0807c30e0ab4 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4702024-11-07T22:45:43.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e9eec126-41e5-4ef9-a5db-0807c30e0ab4 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4712024-11-07T22:45:43.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e9eec126-41e5-4ef9-a5db-0807c30e0ab4 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4722024-11-07T22:45:44.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6d0ccb6a-ba37-4049-925b-a8a38234cf2e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4732024-11-07T22:45:44.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6d0ccb6a-ba37-4049-925b-a8a38234cf2e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4742024-11-07T22:45:44.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6d0ccb6a-ba37-4049-925b-a8a38234cf2e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4752024-11-07T22:45:45.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8442dc63-02e6-462e-9584-aef5716a9a5c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4762024-11-07T22:45:45.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8442dc63-02e6-462e-9584-aef5716a9a5c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4772024-11-07T22:45:45.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8442dc63-02e6-462e-9584-aef5716a9a5c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4782024-11-07T22:45:46.653ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1392 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = a5ab159e-4315-4e79-a299-8f4cce7b850e response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
4792024-11-07T22:45:46.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5fe95e6d-716a-4fb3-8b66-78ff7bf83aa8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4802024-11-07T22:45:46.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5fe95e6d-716a-4fb3-8b66-78ff7bf83aa8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4812024-11-07T22:45:46.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5fe95e6d-716a-4fb3-8b66-78ff7bf83aa8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4822024-11-07T22:45:48.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 46f5e7b7-5f01-43b4-8ae0-d1667fd95ffa roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4832024-11-07T22:45:48.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 46f5e7b7-5f01-43b4-8ae0-d1667fd95ffa resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4842024-11-07T22:45:48.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2708 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 46f5e7b7-5f01-43b4-8ae0-d1667fd95ffa response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4852024-11-07T22:45:49.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3364acf7-ff23-4f2d-af60-0d640b2d08ca roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4862024-11-07T22:45:49.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3364acf7-ff23-4f2d-af60-0d640b2d08ca resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4872024-11-07T22:45:49.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3364acf7-ff23-4f2d-af60-0d640b2d08ca response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4882024-11-07T22:45:50.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6299a18f-213c-4928-94ab-746519ca9d23 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4892024-11-07T22:45:50.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6299a18f-213c-4928-94ab-746519ca9d23 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4902024-11-07T22:45:50.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3075 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6299a18f-213c-4928-94ab-746519ca9d23 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
4912024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
4922024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4932024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
4942024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4952024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
4962024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
4972024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4982024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
4992024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
5002024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5012024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
5022024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
5032024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5042024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
5052024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
5062024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5072024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
5082024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5092024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
5102024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
5112024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5122024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
5132024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
5142024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
5152024-11-07T22:45:50.819ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
5162024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
5172024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5182024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
5192024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
5202024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5212024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
5222024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
5232024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
5242024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
5252024-11-07T22:45:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5262024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5272024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
5282024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5292024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
5302024-11-07T22:45:50.820ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-07 22:35:50.820023935 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
5312024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
5322024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
5332024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5342024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
5352024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5362024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
5372024-11-07T22:45:50.820ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531
5382024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
5392024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 7.11\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531"}
5402024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
5412024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
5422024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
5432024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
5442024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5452024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
5462024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5472024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
5482024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
5492024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5502024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5512024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
5522024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
5532024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5542024-11-07T22:45:50.820ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
5552024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5562024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5572024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5582024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5592024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5602024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5612024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5622024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5632024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5642024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5652024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5662024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5672024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5682024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5692024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5702024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5712024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5722024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5732024-11-07T22:45:50.820ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19da6a5b-073a-4e12-8775-91fc61c1e962.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 844, tv_nsec: 909146638 } })
5742024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5752024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5762024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5772024-11-07T22:45:50.820ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a127151b-10b2-4835-91ce-b493ecd30481.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("de9282a1-0aa7-4ad8-a39a-58f19d05b651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 844, tv_nsec: 909185019 } })
5782024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5792024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5802024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5812024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5822024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5832024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5842024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5852024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5862024-11-07T22:45:50.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5872024-11-07T22:45:50.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5882024-11-07T22:45:50.821ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5892024-11-07T22:45:50.821ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
5902024-11-07T22:45:50.821ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.335485ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
5912024-11-07T22:45:50.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5922024-11-07T22:45:50.821ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
5932024-11-07T22:45:50.821ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.203813ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
5942024-11-07T22:45:50.821ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5952024-11-07T22:45:50.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5962024-11-07T22:45:50.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5972024-11-07T22:45:50.823ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5982024-11-07T22:45:50.824ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 844, tv_nsec: 913371882 } })
5992024-11-07T22:45:50.825ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6002024-11-07T22:45:50.825ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6012024-11-07T22:45:50.825ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6022024-11-07T22:45:50.825ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
6032024-11-07T22:45:50.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6042024-11-07T22:45:50.825ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.348054ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6052024-11-07T22:45:50.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6062024-11-07T22:45:50.826ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6072024-11-07T22:45:50.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6082024-11-07T22:45:50.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6092024-11-07T22:45:50.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6102024-11-07T22:45:50.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6112024-11-07T22:45:50.828ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6122024-11-07T22:45:50.829ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 844, tv_nsec: 917545754 } })
6132024-11-07T22:45:50.829ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.448895ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
6142024-11-07T22:45:50.829ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
6152024-11-07T22:45:50.830ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6162024-11-07T22:45:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6172024-11-07T22:45:50.830ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6182024-11-07T22:45:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6192024-11-07T22:45:50.831ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6202024-11-07T22:45:50.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6212024-11-07T22:45:50.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6222024-11-07T22:45:50.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6232024-11-07T22:45:50.832ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6242024-11-07T22:45:50.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.478063ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
6252024-11-07T22:45:50.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
6262024-11-07T22:45:50.834ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6272024-11-07T22:45:50.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
6282024-11-07T22:45:50.835ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6292024-11-07T22:45:50.835ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6302024-11-07T22:45:50.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6312024-11-07T22:45:50.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6322024-11-07T22:45:50.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6332024-11-07T22:45:50.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6342024-11-07T22:45:50.837ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6352024-11-07T22:45:50.838ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-07 22:35:50.820023935 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
6362024-11-07T22:45:50.838ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.443947ms iteration = 4 status = {"expiration":"2024-11-07T22:35:50.820023935Z","pruned":[]}
6372024-11-07T22:45:50.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6382024-11-07T22:45:50.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6392024-11-07T22:45:50.840ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6402024-11-07T22:45:50.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6412024-11-07T22:45:50.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6422024-11-07T22:45:50.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6432024-11-07T22:45:50.842ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6442024-11-07T22:45:50.842ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6452024-11-07T22:45:50.843ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6462024-11-07T22:45:50.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6472024-11-07T22:45:50.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6482024-11-07T22:45:50.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6492024-11-07T22:45:50.846ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6502024-11-07T22:45:50.846ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6512024-11-07T22:45:50.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6522024-11-07T22:45:50.846ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6532024-11-07T22:45:50.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6542024-11-07T22:45:50.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6552024-11-07T22:45:50.847ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6562024-11-07T22:45:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6572024-11-07T22:45:50.849ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6582024-11-07T22:45:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6592024-11-07T22:45:50.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6602024-11-07T22:45:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6612024-11-07T22:45:50.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6622024-11-07T22:45:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6632024-11-07T22:45:50.862ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 844, tv_nsec: 950511014 } })
6642024-11-07T22:45:50.862ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
6652024-11-07T22:45:50.871ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6662024-11-07T22:45:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6672024-11-07T22:45:50.879ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.627729ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
6682024-11-07T22:45:50.880ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6692024-11-07T22:45:50.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6702024-11-07T22:45:50.882ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6712024-11-07T22:45:50.882ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6722024-11-07T22:45:50.882ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.844705ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6732024-11-07T22:45:50.889ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6742024-11-07T22:45:50.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6752024-11-07T22:45:50.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6762024-11-07T22:45:50.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6772024-11-07T22:45:50.912ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6782024-11-07T22:45:50.912ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 92.367472ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6792024-11-07T22:45:50.912ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6802024-11-07T22:45:50.912ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6812024-11-07T22:45:50.912ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6822024-11-07T22:45:50.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6832024-11-07T22:45:50.916ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6842024-11-07T22:45:50.916ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6852024-11-07T22:45:50.916ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 96.950666ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6862024-11-07T22:45:50.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6872024-11-07T22:45:50.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6882024-11-07T22:45:50.926ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6892024-11-07T22:45:50.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6902024-11-07T22:45:50.960ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6912024-11-07T22:45:50.960ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6922024-11-07T22:45:50.960ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6932024-11-07T22:45:50.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6942024-11-07T22:45:50.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6952024-11-07T22:45:51.000ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
6962024-11-07T22:45:51.009ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
6972024-11-07T22:45:51.026ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6982024-11-07T22:45:51.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6992024-11-07T22:45:51.031ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
7002024-11-07T22:45:51.032ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7012024-11-07T22:45:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
7022024-11-07T22:45:51.034ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
7032024-11-07T22:45:51.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
7042024-11-07T22:45:51.035ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
7052024-11-07T22:45:51.035ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7062024-11-07T22:45:51.035ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4ca593a-3779-4ffa-8668-0f64b0c4a173", "content-length": "64", "date": "Thu, 07 Nov 2024 22:45:51 GMT"} })
7072024-11-07T22:45:51.035ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
7082024-11-07T22:45:51.036ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "892ffacd-475b-4969-b3ef-8d309ad0dd3d", "content-length": "26", "date": "Thu, 07 Nov 2024 22:45:50 GMT"} })
7092024-11-07T22:45:51.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
7102024-11-07T22:45:51.036ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7112024-11-07T22:45:51.038ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
7122024-11-07T22:45:51.039ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7132024-11-07T22:45:51.039ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7142024-11-07T22:45:51.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7152024-11-07T22:45:51.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7162024-11-07T22:45:51.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7172024-11-07T22:45:51.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7182024-11-07T22:45:51.044ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7192024-11-07T22:45:51.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7202024-11-07T22:45:51.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7212024-11-07T22:45:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
7222024-11-07T22:45:51.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7232024-11-07T22:45:51.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7242024-11-07T22:45:51.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f21e7088-0ad0-4858-9928-fcde0288ae4e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
7252024-11-07T22:45:51.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f21e7088-0ad0-4858-9928-fcde0288ae4e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
7262024-11-07T22:45:51.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3741 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f21e7088-0ad0-4858-9928-fcde0288ae4e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
7272024-11-07T22:45:51.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7282024-11-07T22:45:51.101ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7292024-11-07T22:45:51.103ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7302024-11-07T22:45:51.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7312024-11-07T22:45:51.104ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
7322024-11-07T22:45:51.104ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7332024-11-07T22:45:51.104ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "330de097-9b93-4c14-b47b-b2f290a49547", "content-length": "26", "date": "Thu, 07 Nov 2024 22:45:50 GMT"} })
7342024-11-07T22:45:51.104ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7352024-11-07T22:45:51.104ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
7362024-11-07T22:45:51.104ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 285.243887ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
7372024-11-07T22:45:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7382024-11-07T22:45:51.107ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7392024-11-07T22:45:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
7402024-11-07T22:45:51.107ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7412024-11-07T22:45:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7422024-11-07T22:45:51.107ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7432024-11-07T22:45:51.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7442024-11-07T22:45:51.109ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
7452024-11-07T22:45:51.109ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7462024-11-07T22:45:51.110ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c530e3e3-922e-4702-a0ac-01cf981a7e47", "content-length": "26", "date": "Thu, 07 Nov 2024 22:45:50 GMT"} })
7472024-11-07T22:45:51.110ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7482024-11-07T22:45:51.111ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
7492024-11-07T22:45:51.111ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
7502024-11-07T22:45:51.111ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
7512024-11-07T22:45:51.111ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7522024-11-07T22:45:51.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7532024-11-07T22:45:51.112ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7542024-11-07T22:45:51.114ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7552024-11-07T22:45:51.118ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 298.531715ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
7562024-11-07T22:45:51.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7572024-11-07T22:45:51.118ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7582024-11-07T22:45:51.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7592024-11-07T22:45:51.125ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7602024-11-07T22:45:51.125ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7612024-11-07T22:45:51.125ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 305.564035ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7622024-11-07T22:45:51.125ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 305.419142ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7632024-11-07T22:45:51.125ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7642024-11-07T22:45:51.125ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 305.72671ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7652024-11-07T22:45:51.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7662024-11-07T22:45:51.126ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7672024-11-07T22:45:51.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7682024-11-07T22:45:51.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7692024-11-07T22:45:51.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7702024-11-07T22:45:51.137ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7712024-11-07T22:45:51.138ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7722024-11-07T22:45:51.140ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
7732024-11-07T22:45:51.140ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
7742024-11-07T22:45:51.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
7752024-11-07T22:45:51.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7762024-11-07T22:45:51.143ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7772024-11-07T22:45:51.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7782024-11-07T22:45:51.163ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 343.634083ms iteration = 3 status = {"nsuccess":5}
7792024-11-07T22:45:51.169ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7802024-11-07T22:45:51.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7812024-11-07T22:45:51.171ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7822024-11-07T22:45:51.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 354.137397ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
7832024-11-07T22:45:51.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
7842024-11-07T22:45:51.175ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7852024-11-07T22:45:51.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7862024-11-07T22:45:51.181ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
7872024-11-07T22:45:51.181ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7882024-11-07T22:45:51.181ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7892024-11-07T22:45:51.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7902024-11-07T22:45:51.189ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
7912024-11-07T22:45:51.189ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 0 version = 2
7922024-11-07T22:45:51.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7932024-11-07T22:45:51.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7942024-11-07T22:45:51.206ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7952024-11-07T22:45:51.206ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 386.88645ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7962024-11-07T22:45:51.208ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 388.426341ms iteration = 10 status = {"physical_disks_added":0}
7972024-11-07T22:45:51.224ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
7982024-11-07T22:45:51.234ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
7992024-11-07T22:45:51.235ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c1464c95-75dc-42e9-b0f9-bcd0ef6e4e54", "date": "Thu, 07 Nov 2024 22:45:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8002024-11-07T22:45:51.235ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8012024-11-07T22:45:51.237ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8a8158cd-c023-4d5f-93be-6ad39c581948", "date": "Thu, 07 Nov 2024 22:45:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8022024-11-07T22:45:51.237ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8032024-11-07T22:45:51.241ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
8042024-11-07T22:45:51.241ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 421.145634ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
8052024-11-07T22:45:51.242ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8062024-11-07T22:45:51.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8072024-11-07T22:45:51.257ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
8082024-11-07T22:45:51.257ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ae6c5b4-4613-4e0b-9c9e-6118454e860d", "content-length": "1", "date": "Thu, 07 Nov 2024 22:45:50 GMT"} })
8092024-11-07T22:45:51.260ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8102024-11-07T22:45:51.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8112024-11-07T22:45:51.274ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 454.478764ms iteration = 7 status = {}
8122024-11-07T22:45:51.285ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
8132024-11-07T22:45:51.285ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8142024-11-07T22:45:51.285ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "066b9078-f3e1-4e1b-ba17-0591b79034a4", "content-length": "372", "date": "Thu, 07 Nov 2024 22:45:51 GMT"} })
8152024-11-07T22:45:51.285ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8162024-11-07T22:45:51.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8172024-11-07T22:45:51.287ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8182024-11-07T22:45:51.287ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 467.624479ms iteration = 7 status = 0
8192024-11-07T22:45:51.287ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8202024-11-07T22:45:51.289ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
8212024-11-07T22:45:51.289ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8222024-11-07T22:45:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8232024-11-07T22:45:51.290ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8242024-11-07T22:45:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
8252024-11-07T22:45:51.291ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8262024-11-07T22:45:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8272024-11-07T22:45:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
8282024-11-07T22:45:51.293ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8292024-11-07T22:45:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8302024-11-07T22:45:51.295ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 475.48033ms iteration = 7 status = null
8312024-11-07T22:45:51.297ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 1 version = 2
8322024-11-07T22:45:51.297ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
8332024-11-07T22:45:51.297ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-07 22:43:11.643428 UTC dns_group = external generation = 2
8342024-11-07T22:45:51.297ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 477.441964ms iteration = 5 status = {"generation":2}
8352024-11-07T22:45:51.297ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
8362024-11-07T22:45:51.297ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
8372024-11-07T22:45:51.297ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-07 22:43:11.086261 UTC dns_group = internal generation = 1
8382024-11-07T22:45:51.297ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 477.606938ms iteration = 5 status = {"generation":1}
8392024-11-07T22:45:51.299ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-07T22:42:48.907310Z, time_modified: 2024-11-07T22:42:48.907310Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }) }
8402024-11-07T22:45:51.299ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 479.974012ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]}},"default_endpoint":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
8412024-11-07T22:45:51.303ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
8422024-11-07T22:45:51.304ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a3d8d3d2-0675-4a53-aa02-11db82d8239c", "date": "Thu, 07 Nov 2024 22:45:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8432024-11-07T22:45:51.304ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8442024-11-07T22:45:51.306ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "792348dc-e6f1-4a0f-a75a-06e153e56cc9", "date": "Thu, 07 Nov 2024 22:45:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8452024-11-07T22:45:51.306ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8462024-11-07T22:45:51.308ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9476f344-9acf-4660-ba3d-5773c9def063", "date": "Thu, 07 Nov 2024 22:45:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8472024-11-07T22:45:51.308ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8482024-11-07T22:45:51.311ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
8492024-11-07T22:45:51.311ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 491.502123ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
8502024-11-07T22:45:51.339ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8512024-11-07T22:45:51.343ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8522024-11-07T22:45:51.343ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8532024-11-07T22:45:51.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8542024-11-07T22:45:51.354ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8552024-11-07T22:45:51.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8562024-11-07T22:45:51.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8572024-11-07T22:45:51.356ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
8582024-11-07T22:45:51.357ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8592024-11-07T22:45:51.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8602024-11-07T22:45:51.357ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8612024-11-07T22:45:51.357ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8622024-11-07T22:45:51.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8632024-11-07T22:45:51.362ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
8642024-11-07T22:45:51.362ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8652024-11-07T22:45:51.363ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bdcb879d-1c1f-4b12-9d69-9d83f069bcf8", "date": "Thu, 07 Nov 2024 22:45:51 GMT"} })
8662024-11-07T22:45:51.363ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8672024-11-07T22:45:51.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8682024-11-07T22:45:51.366ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8692024-11-07T22:45:51.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8702024-11-07T22:45:51.369ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8712024-11-07T22:45:51.369ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "72d0dfd2-0707-4297-9c48-fa1ae8248f4e", "content-length": "134", "date": "Thu, 07 Nov 2024 22:45:50 GMT"} })
8722024-11-07T22:45:51.369ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8732024-11-07T22:45:51.369ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
8742024-11-07T22:45:51.370ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8752024-11-07T22:45:51.370ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8762024-11-07T22:45:51.370ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8772024-11-07T22:45:51.370ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8782024-11-07T22:45:51.370ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8792024-11-07T22:45:51.370ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8802024-11-07T22:45:51.370ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8812024-11-07T22:45:51.370ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8822024-11-07T22:45:51.370ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8832024-11-07T22:45:51.370ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
8842024-11-07T22:45:51.370ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8852024-11-07T22:45:51.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8862024-11-07T22:45:51.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8872024-11-07T22:45:51.373ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8882024-11-07T22:45:51.373ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc721759-bfc8-4400-8c6f-69661a552362", "content-length": "2", "date": "Thu, 07 Nov 2024 22:45:50 GMT"} })
8892024-11-07T22:45:51.373ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8902024-11-07T22:45:51.373ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e097de75-d031-4e9c-a211-0ba67a4b7394", "content-length": "52", "date": "Thu, 07 Nov 2024 22:45:50 GMT"} })
8912024-11-07T22:45:51.373ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
8922024-11-07T22:45:51.373ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8932024-11-07T22:45:51.374ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
8942024-11-07T22:45:51.374ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8952024-11-07T22:45:51.375ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7b8da27e-f41a-49a6-bac4-c0de387fc906", "date": "Thu, 07 Nov 2024 22:45:51 GMT"} })
8962024-11-07T22:45:51.377ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 557.227207ms iteration = 8 status = {}
8972024-11-07T22:45:51.396ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8982024-11-07T22:45:51.397ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a495c9e2-ca98-4458-9a1e-c45c660a09e4", "content-length": "691", "date": "Thu, 07 Nov 2024 22:45:51 GMT"} })
8992024-11-07T22:45:51.397ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
9002024-11-07T22:45:51.397ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
9012024-11-07T22:45:51.397ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
9022024-11-07T22:45:51.398ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 578.365406ms iteration = 7 status = {}
9032024-11-07T22:45:51.485ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "de7f5c3d-4652-4264-af7e-6b6d28fca142", "date": "Thu, 07 Nov 2024 22:45:51 GMT"} })
9042024-11-07T22:45:51.485ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
9052024-11-07T22:45:51.486ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
9062024-11-07T22:45:51.489ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "41e43864-9018-4010-8518-424a10434c72", "content-length": "682", "date": "Thu, 07 Nov 2024 22:45:51 GMT"} })
9072024-11-07T22:45:51.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9082024-11-07T22:45:51.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9092024-11-07T22:45:51.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9102024-11-07T22:45:51.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9112024-11-07T22:45:51.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = a6c11201-335c-4ac2-8002-2fc6bbf7f05c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
9122024-11-07T22:45:51.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = a6c11201-335c-4ac2-8002-2fc6bbf7f05c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
9132024-11-07T22:45:51.497ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9142024-11-07T22:45:51.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9152024-11-07T22:45:51.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = a6c11201-335c-4ac2-8002-2fc6bbf7f05c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
9162024-11-07T22:45:51.500ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9172024-11-07T22:45:51.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9182024-11-07T22:45:51.507ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 687.871061ms iteration = 7 status = {}
9192024-11-07T22:45:51.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 018bd88a-a0ad-4265-a5ed-cf0790ce5bd5 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
9202024-11-07T22:45:51.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 018bd88a-a0ad-4265-a5ed-cf0790ce5bd5 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
9212024-11-07T22:45:51.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2729 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 018bd88a-a0ad-4265-a5ed-cf0790ce5bd5 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
9222024-11-07T22:45:51.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 83f34720-3262-4cd4-a4d9-d90a012eacb1 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
9232024-11-07T22:45:51.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 83f34720-3262-4cd4-a4d9-d90a012eacb1 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
9242024-11-07T22:45:51.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 83f34720-3262-4cd4-a4d9-d90a012eacb1 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
9252024-11-07T22:45:52.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7fd36434-a188-42dd-b653-7098a5c587a8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9262024-11-07T22:45:52.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7fd36434-a188-42dd-b653-7098a5c587a8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9272024-11-07T22:45:52.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1826 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7fd36434-a188-42dd-b653-7098a5c587a8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9282024-11-07T22:45:53.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d5638fa7-7e59-4f6f-8bd7-abcf2be4da86 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9292024-11-07T22:45:53.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d5638fa7-7e59-4f6f-8bd7-abcf2be4da86 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9302024-11-07T22:45:53.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2861 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d5638fa7-7e59-4f6f-8bd7-abcf2be4da86 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9312024-11-07T22:45:54.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 743c7f2d-075d-4702-92bc-ce857014c4f7 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9322024-11-07T22:45:54.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 743c7f2d-075d-4702-92bc-ce857014c4f7 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9332024-11-07T22:45:54.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3122 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 743c7f2d-075d-4702-92bc-ce857014c4f7 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9342024-11-07T22:45:55.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 901f5f68-1bb5-4378-94c5-6687b4505924 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9352024-11-07T22:45:55.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 901f5f68-1bb5-4378-94c5-6687b4505924 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9362024-11-07T22:45:55.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 901f5f68-1bb5-4378-94c5-6687b4505924 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9372024-11-07T22:45:56.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 18d4a003-5705-4775-9aa5-db03241821f6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9382024-11-07T22:45:56.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 18d4a003-5705-4775-9aa5-db03241821f6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9392024-11-07T22:45:56.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 18d4a003-5705-4775-9aa5-db03241821f6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9402024-11-07T22:45:57.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 50af274d-3092-4f24-84a3-93a7a6233155 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9412024-11-07T22:45:57.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 50af274d-3092-4f24-84a3-93a7a6233155 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9422024-11-07T22:45:57.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 50af274d-3092-4f24-84a3-93a7a6233155 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9432024-11-07T22:45:58.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 49b351ca-3c98-434b-9e69-a762456ed7fb roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9442024-11-07T22:45:58.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 49b351ca-3c98-434b-9e69-a762456ed7fb resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9452024-11-07T22:45:58.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 49b351ca-3c98-434b-9e69-a762456ed7fb response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9462024-11-07T22:45:59.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ab1981dc-013c-44a1-9cef-04544d320e96 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9472024-11-07T22:45:59.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ab1981dc-013c-44a1-9cef-04544d320e96 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9482024-11-07T22:45:59.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ab1981dc-013c-44a1-9cef-04544d320e96 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9492024-11-07T22:46:00.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6faa1c36-4fa5-4b30-9eca-ca356aee6b95 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9502024-11-07T22:46:00.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6faa1c36-4fa5-4b30-9eca-ca356aee6b95 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9512024-11-07T22:46:00.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6faa1c36-4fa5-4b30-9eca-ca356aee6b95 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9522024-11-07T22:46:00.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
9532024-11-07T22:46:00.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
9542024-11-07T22:46:00.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9552024-11-07T22:46:00.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9562024-11-07T22:46:00.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9572024-11-07T22:46:00.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9582024-11-07T22:46:00.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9592024-11-07T22:46:00.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9602024-11-07T22:46:00.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9612024-11-07T22:46:00.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9622024-11-07T22:46:00.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9632024-11-07T22:46:00.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9642024-11-07T22:46:00.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9652024-11-07T22:46:00.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9662024-11-07T22:46:00.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9672024-11-07T22:46:00.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
9682024-11-07T22:46:00.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9692024-11-07T22:46:00.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9702024-11-07T22:46:00.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
9712024-11-07T22:46:00.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.366423ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
9722024-11-07T22:46:00.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.339579ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9732024-11-07T22:46:01.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ae084164-3c30-4f43-ac54-fed9af5a9e3e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9742024-11-07T22:46:01.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ae084164-3c30-4f43-ac54-fed9af5a9e3e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9752024-11-07T22:46:01.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1747 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ae084164-3c30-4f43-ac54-fed9af5a9e3e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9762024-11-07T22:46:01.654ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1394 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = cbd36886-16e8-4339-b8dc-d8e7350690a3 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
9772024-11-07T22:46:02.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9c0139a9-ef68-407c-a75e-8cf2a64ef18e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9782024-11-07T22:46:02.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9c0139a9-ef68-407c-a75e-8cf2a64ef18e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9792024-11-07T22:46:02.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2892 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9c0139a9-ef68-407c-a75e-8cf2a64ef18e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9802024-11-07T22:46:03.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 676d64ff-901c-42db-b3f3-b84f0643a5b7 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9812024-11-07T22:46:03.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 676d64ff-901c-42db-b3f3-b84f0643a5b7 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9822024-11-07T22:46:03.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3014 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 676d64ff-901c-42db-b3f3-b84f0643a5b7 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9832024-11-07T22:46:04.074ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:44019
9842024-11-07T22:46:04.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44019 req_id = 4f946f13-b92c-4313-8fa5-695f197ea6a9 roles = RoleSet { roles: {} } uri = /metrics/producers
9852024-11-07T22:46:04.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44019 req_id = 4f946f13-b92c-4313-8fa5-695f197ea6a9 resource = Database result = Ok(()) uri = /metrics/producers
9862024-11-07T22:46:04.112ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = e777764e-54ab-4a09-9e71-5c47b8b59e5e
9872024-11-07T22:46:04.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37359 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44019 req_id = 4f946f13-b92c-4313-8fa5-695f197ea6a9 response_code = 201 uri = /metrics/producers
9882024-11-07T22:46:04.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = aa052434-d325-4714-8dcf-1cfe1b8ca184 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9892024-11-07T22:46:04.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = aa052434-d325-4714-8dcf-1cfe1b8ca184 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9902024-11-07T22:46:04.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2479 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = aa052434-d325-4714-8dcf-1cfe1b8ca184 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9912024-11-07T22:46:05.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6eaed261-a09b-4c42-b844-44390b163c79 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9922024-11-07T22:46:05.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6eaed261-a09b-4c42-b844-44390b163c79 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9932024-11-07T22:46:05.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6eaed261-a09b-4c42-b844-44390b163c79 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
9942024-11-07T22:46:05.524ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:45175
9952024-11-07T22:46:05.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45175 req_id = 60ab7f0f-5ecf-43c9-b2c8-0e3272e9381f roles = RoleSet { roles: {} } uri = /metrics/producers
9962024-11-07T22:46:05.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45175 req_id = 60ab7f0f-5ecf-43c9-b2c8-0e3272e9381f resource = Database result = Ok(()) uri = /metrics/producers
9972024-11-07T22:46:05.570ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 5fb8d961-b437-4fc7-94a2-b09d338a9d9d
9982024-11-07T22:46:05.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45382 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45175 req_id = 60ab7f0f-5ecf-43c9-b2c8-0e3272e9381f response_code = 201 uri = /metrics/producers
9992024-11-07T22:46:06.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8946f5dd-b089-4b0e-ac9a-265065137dbc roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10002024-11-07T22:46:06.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8946f5dd-b089-4b0e-ac9a-265065137dbc resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10012024-11-07T22:46:06.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8946f5dd-b089-4b0e-ac9a-265065137dbc response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10022024-11-07T22:46:07.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d408ac5a-096e-4887-8ece-958d3a6cb63f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10032024-11-07T22:46:07.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d408ac5a-096e-4887-8ece-958d3a6cb63f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10042024-11-07T22:46:07.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3023 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d408ac5a-096e-4887-8ece-958d3a6cb63f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10052024-11-07T22:46:08.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f26836b6-73e5-472f-bda8-b76a8fe75568 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10062024-11-07T22:46:08.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f26836b6-73e5-472f-bda8-b76a8fe75568 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10072024-11-07T22:46:08.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2869 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f26836b6-73e5-472f-bda8-b76a8fe75568 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10082024-11-07T22:46:09.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 33fdecc7-51dd-478f-9110-00c0710b22ed roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10092024-11-07T22:46:09.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 33fdecc7-51dd-478f-9110-00c0710b22ed resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10102024-11-07T22:46:09.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 33fdecc7-51dd-478f-9110-00c0710b22ed response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10112024-11-07T22:46:10.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 529e91c1-4441-4e53-a3a5-071b7472d869 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10122024-11-07T22:46:10.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 529e91c1-4441-4e53-a3a5-071b7472d869 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10132024-11-07T22:46:10.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 529e91c1-4441-4e53-a3a5-071b7472d869 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10142024-11-07T22:46:10.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
10152024-11-07T22:46:10.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
10162024-11-07T22:46:10.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10172024-11-07T22:46:10.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10182024-11-07T22:46:10.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10192024-11-07T22:46:10.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10202024-11-07T22:46:10.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10212024-11-07T22:46:10.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10222024-11-07T22:46:10.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10232024-11-07T22:46:10.824ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.655486ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10242024-11-07T22:46:10.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10252024-11-07T22:46:10.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10262024-11-07T22:46:10.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10272024-11-07T22:46:10.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10282024-11-07T22:46:10.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10292024-11-07T22:46:10.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10302024-11-07T22:46:10.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
10312024-11-07T22:46:10.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10322024-11-07T22:46:10.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10332024-11-07T22:46:10.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
10342024-11-07T22:46:10.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.933769ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
10352024-11-07T22:46:11.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6f9ad92e-ea9d-43a8-af0f-51e41d01dfb6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10362024-11-07T22:46:11.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6f9ad92e-ea9d-43a8-af0f-51e41d01dfb6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10372024-11-07T22:46:11.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6f9ad92e-ea9d-43a8-af0f-51e41d01dfb6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10382024-11-07T22:46:12.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5b0034ee-3465-4f7d-a1d7-bb7a79b92104 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10392024-11-07T22:46:12.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5b0034ee-3465-4f7d-a1d7-bb7a79b92104 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10402024-11-07T22:46:12.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2866 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5b0034ee-3465-4f7d-a1d7-bb7a79b92104 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10412024-11-07T22:46:13.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 088c74ce-3272-4a4d-a4b7-b2985b1bb5b8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10422024-11-07T22:46:13.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 088c74ce-3272-4a4d-a4b7-b2985b1bb5b8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10432024-11-07T22:46:13.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 088c74ce-3272-4a4d-a4b7-b2985b1bb5b8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10442024-11-07T22:46:14.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 44bcd71c-7af4-4390-bcd0-53df27912ea7 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10452024-11-07T22:46:14.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 44bcd71c-7af4-4390-bcd0-53df27912ea7 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10462024-11-07T22:46:14.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 44bcd71c-7af4-4390-bcd0-53df27912ea7 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10472024-11-07T22:46:15.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0faaca63-3c54-4cd8-8798-6351379b2dea roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10482024-11-07T22:46:15.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0faaca63-3c54-4cd8-8798-6351379b2dea resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10492024-11-07T22:46:15.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0faaca63-3c54-4cd8-8798-6351379b2dea response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10502024-11-07T22:46:16.654ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1310 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = b69ac268-37a4-45ad-b3af-d21cb0df6dcb response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
10512024-11-07T22:46:16.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 18c5cf38-c92a-48cb-b660-35b7bfbd9261 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10522024-11-07T22:46:16.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 18c5cf38-c92a-48cb-b660-35b7bfbd9261 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10532024-11-07T22:46:16.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2842 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 18c5cf38-c92a-48cb-b660-35b7bfbd9261 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10542024-11-07T22:46:17.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0080a038-f996-4384-a679-f5994a8b7344 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10552024-11-07T22:46:17.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0080a038-f996-4384-a679-f5994a8b7344 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10562024-11-07T22:46:17.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2874 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0080a038-f996-4384-a679-f5994a8b7344 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10572024-11-07T22:46:18.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f734e8c9-d94c-4aff-b28c-03f3249f14ce roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10582024-11-07T22:46:18.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f734e8c9-d94c-4aff-b28c-03f3249f14ce resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10592024-11-07T22:46:18.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1803 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f734e8c9-d94c-4aff-b28c-03f3249f14ce response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10602024-11-07T22:46:19.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 63c80fdb-f762-4068-935c-1bbd3eaf5844 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10612024-11-07T22:46:19.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 63c80fdb-f762-4068-935c-1bbd3eaf5844 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10622024-11-07T22:46:19.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2852 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 63c80fdb-f762-4068-935c-1bbd3eaf5844 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10632024-11-07T22:46:20.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fbef40d0-d96e-43eb-9f1f-1db8389d671d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10642024-11-07T22:46:20.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fbef40d0-d96e-43eb-9f1f-1db8389d671d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10652024-11-07T22:46:20.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2832 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fbef40d0-d96e-43eb-9f1f-1db8389d671d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
10662024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
10672024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
10682024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10692024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
10702024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10712024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10722024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10732024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
10742024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10752024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
10762024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
10772024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10782024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10792024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
10802024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10812024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
10822024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10832024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
10842024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10852024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
10862024-11-07T22:46:20.819ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10872024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
10882024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10892024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10902024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
10912024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10922024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
10932024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
10942024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10952024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
10962024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
10972024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
10982024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10992024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11002024-11-07T22:46:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11012024-11-07T22:46:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11022024-11-07T22:46:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11032024-11-07T22:46:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11042024-11-07T22:46:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11052024-11-07T22:46:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11062024-11-07T22:46:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
11072024-11-07T22:46:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11082024-11-07T22:46:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11092024-11-07T22:46:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11102024-11-07T22:46:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11112024-11-07T22:46:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11122024-11-07T22:46:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11132024-11-07T22:46:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11142024-11-07T22:46:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11152024-11-07T22:46:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
11162024-11-07T22:46:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
11172024-11-07T22:46:20.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11182024-11-07T22:46:20.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11192024-11-07T22:46:20.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11202024-11-07T22:46:20.823ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.551056ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
11212024-11-07T22:46:20.823ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 874, tv_nsec: 912227121 } })
11222024-11-07T22:46:20.824ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
11232024-11-07T22:46:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11242024-11-07T22:46:20.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11252024-11-07T22:46:20.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11262024-11-07T22:46:20.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11272024-11-07T22:46:20.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11282024-11-07T22:46:20.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11292024-11-07T22:46:20.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11302024-11-07T22:46:20.825ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11312024-11-07T22:46:20.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11322024-11-07T22:46:20.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11332024-11-07T22:46:20.828ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11342024-11-07T22:46:20.828ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11352024-11-07T22:46:20.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11362024-11-07T22:46:20.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11372024-11-07T22:46:20.828ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11382024-11-07T22:46:20.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11392024-11-07T22:46:20.829ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11402024-11-07T22:46:20.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11412024-11-07T22:46:20.831ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11422024-11-07T22:46:20.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11432024-11-07T22:46:20.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11442024-11-07T22:46:20.836ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11452024-11-07T22:46:20.836ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 874, tv_nsec: 924656746 } })
11462024-11-07T22:46:20.836ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
11472024-11-07T22:46:20.837ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 874, tv_nsec: 925621792 } })
11482024-11-07T22:46:20.837ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
11492024-11-07T22:46:20.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 18.399567ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11502024-11-07T22:46:20.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11512024-11-07T22:46:20.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11522024-11-07T22:46:20.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11532024-11-07T22:46:20.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11542024-11-07T22:46:20.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11552024-11-07T22:46:20.840ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11562024-11-07T22:46:20.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11572024-11-07T22:46:20.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11582024-11-07T22:46:20.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11592024-11-07T22:46:20.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11602024-11-07T22:46:20.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
11612024-11-07T22:46:20.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11622024-11-07T22:46:20.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11632024-11-07T22:46:20.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
11642024-11-07T22:46:20.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.196258ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
11652024-11-07T22:46:20.863ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11662024-11-07T22:46:20.863ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11672024-11-07T22:46:20.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11682024-11-07T22:46:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11692024-11-07T22:46:20.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.404445ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
11702024-11-07T22:46:20.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11712024-11-07T22:46:20.876ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11722024-11-07T22:46:20.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11732024-11-07T22:46:20.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.006362ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
11742024-11-07T22:46:20.879ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11752024-11-07T22:46:20.879ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11762024-11-07T22:46:20.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11772024-11-07T22:46:20.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11782024-11-07T22:46:20.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11792024-11-07T22:46:20.882ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11802024-11-07T22:46:20.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11812024-11-07T22:46:20.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11822024-11-07T22:46:20.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11832024-11-07T22:46:20.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11842024-11-07T22:46:20.887ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11852024-11-07T22:46:20.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11862024-11-07T22:46:20.888ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11872024-11-07T22:46:20.888ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.788636ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11882024-11-07T22:46:20.889ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11892024-11-07T22:46:20.890ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 70.905224ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
11902024-11-07T22:46:20.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
11912024-11-07T22:46:20.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11922024-11-07T22:46:20.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11932024-11-07T22:46:20.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11942024-11-07T22:46:20.893ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11952024-11-07T22:46:20.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11962024-11-07T22:46:20.895ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 75.823356ms iteration = 8 status = 0
11972024-11-07T22:46:20.914ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
11982024-11-07T22:46:20.914ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11992024-11-07T22:46:20.915ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b06de4e-66d4-4f3e-803e-7df78fbabe82", "content-length": "26", "date": "Thu, 07 Nov 2024 22:46:20 GMT"} })
12002024-11-07T22:46:20.915ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12012024-11-07T22:46:20.917ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12022024-11-07T22:46:20.917ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
12032024-11-07T22:46:20.917ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12042024-11-07T22:46:20.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12052024-11-07T22:46:20.918ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12062024-11-07T22:46:20.929ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 109.545966ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
12072024-11-07T22:46:20.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 112.952657ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12082024-11-07T22:46:20.938ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
12092024-11-07T22:46:20.938ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12102024-11-07T22:46:20.938ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "67d86106-a433-407f-8cf7-ad3941949468", "content-length": "26", "date": "Thu, 07 Nov 2024 22:46:20 GMT"} })
12112024-11-07T22:46:20.938ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12122024-11-07T22:46:20.939ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12132024-11-07T22:46:20.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12142024-11-07T22:46:20.940ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
12152024-11-07T22:46:20.940ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12162024-11-07T22:46:20.940ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12172024-11-07T22:46:20.940ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2e8cb34-4071-400d-bbd7-5ffb8a6ea8ea", "content-length": "26", "date": "Thu, 07 Nov 2024 22:46:20 GMT"} })
12182024-11-07T22:46:20.940ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12192024-11-07T22:46:20.941ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 121.793567ms iteration = 11 status = {"physical_disks_added":0}
12202024-11-07T22:46:20.942ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
12212024-11-07T22:46:20.961ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12222024-11-07T22:46:20.961ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
12232024-11-07T22:46:20.961ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.241278ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
12242024-11-07T22:46:21.070ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12252024-11-07T22:46:21.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12262024-11-07T22:46:21.098ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
12272024-11-07T22:46:21.098ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12282024-11-07T22:46:21.098ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e13b7f1-de01-4aee-abb1-f9d6fa03aff9", "content-length": "372", "date": "Thu, 07 Nov 2024 22:46:21 GMT"} })
12292024-11-07T22:46:21.098ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12302024-11-07T22:46:21.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12312024-11-07T22:46:21.099ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
12322024-11-07T22:46:21.099ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "49d68f45-28ce-4d02-b593-0f38c081db23", "content-length": "1", "date": "Thu, 07 Nov 2024 22:46:20 GMT"} })
12332024-11-07T22:46:21.099ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12342024-11-07T22:46:21.100ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12352024-11-07T22:46:21.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12362024-11-07T22:46:21.102ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12372024-11-07T22:46:21.102ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12382024-11-07T22:46:21.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12392024-11-07T22:46:21.103ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12402024-11-07T22:46:21.104ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 284.580199ms iteration = 8 status = null
12412024-11-07T22:46:21.106ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12422024-11-07T22:46:21.106ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12432024-11-07T22:46:21.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12442024-11-07T22:46:21.125ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
12452024-11-07T22:46:21.125ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
12462024-11-07T22:46:21.125ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ce6252c0-b78d-4fa5-afdf-4390e7ac4b44", "date": "Thu, 07 Nov 2024 22:46:21 GMT"} })
12472024-11-07T22:46:21.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12482024-11-07T22:46:21.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12492024-11-07T22:46:21.132ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 312.490033ms iteration = 8 status = {}
12502024-11-07T22:46:21.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12512024-11-07T22:46:21.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12522024-11-07T22:46:21.137ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12532024-11-07T22:46:21.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12542024-11-07T22:46:21.140ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
12552024-11-07T22:46:21.140ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12562024-11-07T22:46:21.140ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "87ccb542-8fd1-4ea0-9a38-1c6151d03b9f", "date": "Thu, 07 Nov 2024 22:46:21 GMT"} })
12572024-11-07T22:46:21.142ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 323.113129ms iteration = 9 status = {}
12582024-11-07T22:46:21.171ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12592024-11-07T22:46:21.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12602024-11-07T22:46:21.173ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
12612024-11-07T22:46:21.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12622024-11-07T22:46:21.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12632024-11-07T22:46:21.181ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
12642024-11-07T22:46:21.181ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "abe3a381-37c0-4087-b8ce-092daac39d38", "content-length": "134", "date": "Thu, 07 Nov 2024 22:46:20 GMT"} })
12652024-11-07T22:46:21.181ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
12662024-11-07T22:46:21.181ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
12672024-11-07T22:46:21.181ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
12682024-11-07T22:46:21.181ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
12692024-11-07T22:46:21.181ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12702024-11-07T22:46:21.181ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12712024-11-07T22:46:21.181ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12722024-11-07T22:46:21.181ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12732024-11-07T22:46:21.181ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12742024-11-07T22:46:21.181ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12752024-11-07T22:46:21.181ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
12762024-11-07T22:46:21.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12772024-11-07T22:46:21.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12782024-11-07T22:46:21.203ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12792024-11-07T22:46:21.205ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
12802024-11-07T22:46:21.205ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ef5c9fc-1868-43ec-8a23-e6447fd50799", "content-length": "2", "date": "Thu, 07 Nov 2024 22:46:20 GMT"} })
12812024-11-07T22:46:21.205ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
12822024-11-07T22:46:21.205ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2a9e319-3538-4006-8a6a-c53b2cf11416", "content-length": "52", "date": "Thu, 07 Nov 2024 22:46:20 GMT"} })
12832024-11-07T22:46:21.205ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
12842024-11-07T22:46:21.205ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
12852024-11-07T22:46:21.300ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b92958c4-db76-4808-928f-05b66b0bf05f", "content-length": "691", "date": "Thu, 07 Nov 2024 22:46:21 GMT"} })
12862024-11-07T22:46:21.300ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
12872024-11-07T22:46:21.301ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
12882024-11-07T22:46:21.301ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
12892024-11-07T22:46:21.302ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 482.606523ms iteration = 8 status = {}
12902024-11-07T22:46:21.397ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "58fca9e0-5911-4f95-9c7f-775b4c4323b1", "date": "Thu, 07 Nov 2024 22:46:21 GMT"} })
12912024-11-07T22:46:21.397ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
12922024-11-07T22:46:21.397ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
12932024-11-07T22:46:21.401ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b9d861e-431b-48ec-9bfb-3da57bb764c9", "content-length": "682", "date": "Thu, 07 Nov 2024 22:46:21 GMT"} })
12942024-11-07T22:46:21.401ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12952024-11-07T22:46:21.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12962024-11-07T22:46:21.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12972024-11-07T22:46:21.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12982024-11-07T22:46:21.410ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12992024-11-07T22:46:21.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13002024-11-07T22:46:21.412ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13012024-11-07T22:46:21.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13022024-11-07T22:46:21.420ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 601.241604ms iteration = 8 status = {}
13032024-11-07T22:46:21.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 18f5142a-9f39-4e3a-89c0-d73c5e29b9d5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
13042024-11-07T22:46:21.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 18f5142a-9f39-4e3a-89c0-d73c5e29b9d5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
13052024-11-07T22:46:21.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5720 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 18f5142a-9f39-4e3a-89c0-d73c5e29b9d5 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
13062024-11-07T22:46:21.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3c4edf08-ab35-4844-b7ca-ca3e1670535d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13072024-11-07T22:46:21.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3c4edf08-ab35-4844-b7ca-ca3e1670535d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13082024-11-07T22:46:21.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2441 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3c4edf08-ab35-4844-b7ca-ca3e1670535d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13092024-11-07T22:46:22.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f9411351-76a7-4d19-b563-029d0faf7af5 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13102024-11-07T22:46:22.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f9411351-76a7-4d19-b563-029d0faf7af5 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13112024-11-07T22:46:22.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2067 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f9411351-76a7-4d19-b563-029d0faf7af5 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13122024-11-07T22:46:23.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 872e6680-c979-43d0-b425-daaaea54b76e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13132024-11-07T22:46:23.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 872e6680-c979-43d0-b425-daaaea54b76e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13142024-11-07T22:46:23.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2860 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 872e6680-c979-43d0-b425-daaaea54b76e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13152024-11-07T22:46:24.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1d8e8c7a-b410-429d-979a-bd7a2989229f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13162024-11-07T22:46:24.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1d8e8c7a-b410-429d-979a-bd7a2989229f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13172024-11-07T22:46:24.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1d8e8c7a-b410-429d-979a-bd7a2989229f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13182024-11-07T22:46:25.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9fd73eb0-0deb-46b6-a0a7-0b7198662882 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13192024-11-07T22:46:25.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9fd73eb0-0deb-46b6-a0a7-0b7198662882 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13202024-11-07T22:46:25.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9fd73eb0-0deb-46b6-a0a7-0b7198662882 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13212024-11-07T22:46:26.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 724711a7-4ab2-4872-99cb-f04b6e61d107 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13222024-11-07T22:46:26.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 724711a7-4ab2-4872-99cb-f04b6e61d107 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13232024-11-07T22:46:26.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 724711a7-4ab2-4872-99cb-f04b6e61d107 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13242024-11-07T22:46:27.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 06fbf420-097f-4169-8efe-28b527c2bd60 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13252024-11-07T22:46:27.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 06fbf420-097f-4169-8efe-28b527c2bd60 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13262024-11-07T22:46:27.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1788 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 06fbf420-097f-4169-8efe-28b527c2bd60 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13272024-11-07T22:46:28.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a8ca5ddb-27e9-4d00-a72b-d3214d79100e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13282024-11-07T22:46:28.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a8ca5ddb-27e9-4d00-a72b-d3214d79100e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13292024-11-07T22:46:28.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a8ca5ddb-27e9-4d00-a72b-d3214d79100e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13302024-11-07T22:46:29.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0b1cf40b-4d62-4b99-ae64-cf52f73d9461 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13312024-11-07T22:46:29.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0b1cf40b-4d62-4b99-ae64-cf52f73d9461 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13322024-11-07T22:46:29.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0b1cf40b-4d62-4b99-ae64-cf52f73d9461 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13332024-11-07T22:46:30.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
13342024-11-07T22:46:30.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13352024-11-07T22:46:30.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
13362024-11-07T22:46:30.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13372024-11-07T22:46:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13382024-11-07T22:46:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13392024-11-07T22:46:30.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13402024-11-07T22:46:30.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13412024-11-07T22:46:30.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13422024-11-07T22:46:30.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13432024-11-07T22:46:30.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13442024-11-07T22:46:30.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13452024-11-07T22:46:30.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13462024-11-07T22:46:30.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13472024-11-07T22:46:30.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13482024-11-07T22:46:30.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
13492024-11-07T22:46:30.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13502024-11-07T22:46:30.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13512024-11-07T22:46:30.843ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
13522024-11-07T22:46:30.843ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.234044ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
13532024-11-07T22:46:30.849ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.941005ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13542024-11-07T22:46:30.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 816e3db7-9e5c-4dcc-89d5-005c4d3ce0a9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13552024-11-07T22:46:30.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 816e3db7-9e5c-4dcc-89d5-005c4d3ce0a9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13562024-11-07T22:46:30.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 816e3db7-9e5c-4dcc-89d5-005c4d3ce0a9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13572024-11-07T22:46:31.654ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1405 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = f0f79925-9dac-49cc-bb4f-0a9004b3a562 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
13582024-11-07T22:46:31.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c6f4b6d7-8f94-463c-bd5e-79d2da9b2861 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13592024-11-07T22:46:31.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c6f4b6d7-8f94-463c-bd5e-79d2da9b2861 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13602024-11-07T22:46:31.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c6f4b6d7-8f94-463c-bd5e-79d2da9b2861 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13612024-11-07T22:46:33.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 573aac78-bf56-4b0c-aa3d-161cee8997dd roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13622024-11-07T22:46:33.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 573aac78-bf56-4b0c-aa3d-161cee8997dd resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13632024-11-07T22:46:33.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5769 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 573aac78-bf56-4b0c-aa3d-161cee8997dd response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13642024-11-07T22:46:34.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 211d1d72-a59f-408d-ae82-5265aae9af65 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13652024-11-07T22:46:34.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 211d1d72-a59f-408d-ae82-5265aae9af65 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13662024-11-07T22:46:34.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 211d1d72-a59f-408d-ae82-5265aae9af65 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13672024-11-07T22:46:35.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f72ad57b-fa43-46b5-9e28-956f47d78252 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13682024-11-07T22:46:35.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f72ad57b-fa43-46b5-9e28-956f47d78252 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13692024-11-07T22:46:35.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f72ad57b-fa43-46b5-9e28-956f47d78252 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13702024-11-07T22:46:36.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c401ee85-8576-4a0d-a313-0bd84c021bf4 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13712024-11-07T22:46:36.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c401ee85-8576-4a0d-a313-0bd84c021bf4 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13722024-11-07T22:46:36.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c401ee85-8576-4a0d-a313-0bd84c021bf4 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13732024-11-07T22:46:36.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 620e3a4c-bdb8-46fc-b222-cc4b2c8f88c6 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
13742024-11-07T22:46:36.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 620e3a4c-bdb8-46fc-b222-cc4b2c8f88c6 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
13752024-11-07T22:46:36.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 620e3a4c-bdb8-46fc-b222-cc4b2c8f88c6 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
13762024-11-07T22:46:36.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 5a29f9c9-ce91-454c-9e80-90fa93765585 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
13772024-11-07T22:46:36.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 5a29f9c9-ce91-454c-9e80-90fa93765585 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
13782024-11-07T22:46:36.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 5a29f9c9-ce91-454c-9e80-90fa93765585 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
13792024-11-07T22:46:37.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4ab592e5-9f29-49d1-9ff1-f11e35ea01d4 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13802024-11-07T22:46:37.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4ab592e5-9f29-49d1-9ff1-f11e35ea01d4 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13812024-11-07T22:46:37.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2660 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4ab592e5-9f29-49d1-9ff1-f11e35ea01d4 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13822024-11-07T22:46:38.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d3032bf2-781c-4d52-a3e7-5756d0dd8317 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13832024-11-07T22:46:38.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d3032bf2-781c-4d52-a3e7-5756d0dd8317 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13842024-11-07T22:46:38.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d3032bf2-781c-4d52-a3e7-5756d0dd8317 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13852024-11-07T22:46:39.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2bf4051a-d811-4aa8-aafb-1c63a024ce9f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13862024-11-07T22:46:39.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2bf4051a-d811-4aa8-aafb-1c63a024ce9f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13872024-11-07T22:46:39.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2bf4051a-d811-4aa8-aafb-1c63a024ce9f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13882024-11-07T22:46:40.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = eafb2e8e-6514-40c3-af33-cc72df30cdf8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13892024-11-07T22:46:40.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = eafb2e8e-6514-40c3-af33-cc72df30cdf8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13902024-11-07T22:46:40.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = eafb2e8e-6514-40c3-af33-cc72df30cdf8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
13912024-11-07T22:46:40.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
13922024-11-07T22:46:40.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
13932024-11-07T22:46:40.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13942024-11-07T22:46:40.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13952024-11-07T22:46:40.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13962024-11-07T22:46:40.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13972024-11-07T22:46:40.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13982024-11-07T22:46:40.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13992024-11-07T22:46:40.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14002024-11-07T22:46:40.824ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.404099ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14012024-11-07T22:46:40.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14022024-11-07T22:46:40.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14032024-11-07T22:46:40.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14042024-11-07T22:46:40.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14052024-11-07T22:46:40.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14062024-11-07T22:46:40.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14072024-11-07T22:46:40.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
14082024-11-07T22:46:40.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14092024-11-07T22:46:40.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14102024-11-07T22:46:40.864ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
14112024-11-07T22:46:40.865ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.278202ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
14122024-11-07T22:46:41.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = da676a4f-c00d-484c-a83a-97ccecfd6df3 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14132024-11-07T22:46:41.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = da676a4f-c00d-484c-a83a-97ccecfd6df3 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14142024-11-07T22:46:41.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3045 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = da676a4f-c00d-484c-a83a-97ccecfd6df3 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14152024-11-07T22:46:42.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f707c3e1-25c1-406e-9549-51ee36305dc0 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14162024-11-07T22:46:42.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f707c3e1-25c1-406e-9549-51ee36305dc0 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14172024-11-07T22:46:42.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2602 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f707c3e1-25c1-406e-9549-51ee36305dc0 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14182024-11-07T22:46:43.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 57db5874-0ac7-4703-ac0c-0f206744b17a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14192024-11-07T22:46:43.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 57db5874-0ac7-4703-ac0c-0f206744b17a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14202024-11-07T22:46:43.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2712 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 57db5874-0ac7-4703-ac0c-0f206744b17a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14212024-11-07T22:46:44.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 38873454-861f-4781-adfd-db019c6f01d1 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14222024-11-07T22:46:44.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 38873454-861f-4781-adfd-db019c6f01d1 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14232024-11-07T22:46:44.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 38873454-861f-4781-adfd-db019c6f01d1 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14242024-11-07T22:46:45.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9f1bbdd2-08a8-4ad3-b8a5-7c7176eea7b1 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14252024-11-07T22:46:45.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9f1bbdd2-08a8-4ad3-b8a5-7c7176eea7b1 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14262024-11-07T22:46:45.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9f1bbdd2-08a8-4ad3-b8a5-7c7176eea7b1 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14272024-11-07T22:46:46.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ddcbb024-c995-406b-9365-0ee25b313037 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14282024-11-07T22:46:46.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ddcbb024-c995-406b-9365-0ee25b313037 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14292024-11-07T22:46:46.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ddcbb024-c995-406b-9365-0ee25b313037 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14302024-11-07T22:46:46.655ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1811 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = d1bb29c5-c7e2-4587-b65c-55da72eb9324 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
14312024-11-07T22:46:47.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b9e83daa-c044-4505-b71e-aaf4de00e8d6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14322024-11-07T22:46:47.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b9e83daa-c044-4505-b71e-aaf4de00e8d6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14332024-11-07T22:46:47.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b9e83daa-c044-4505-b71e-aaf4de00e8d6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14342024-11-07T22:46:48.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1a36fabf-1b04-4d22-b7e1-bc5864cf0a78 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14352024-11-07T22:46:48.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1a36fabf-1b04-4d22-b7e1-bc5864cf0a78 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14362024-11-07T22:46:48.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1a36fabf-1b04-4d22-b7e1-bc5864cf0a78 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14372024-11-07T22:46:49.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 41de8963-6350-4932-8d83-6e2b96ff7189 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14382024-11-07T22:46:49.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 41de8963-6350-4932-8d83-6e2b96ff7189 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14392024-11-07T22:46:49.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1952 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 41de8963-6350-4932-8d83-6e2b96ff7189 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14402024-11-07T22:46:50.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2d8ff3d9-eb45-4ca7-b19c-13ffaac6a8c1 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14412024-11-07T22:46:50.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2d8ff3d9-eb45-4ca7-b19c-13ffaac6a8c1 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14422024-11-07T22:46:50.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2437 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2d8ff3d9-eb45-4ca7-b19c-13ffaac6a8c1 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
14432024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
14442024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14452024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
14462024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
14472024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14482024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
14492024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
14502024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
14512024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14522024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14532024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
14542024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14552024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
14562024-11-07T22:46:50.819ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
14572024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
14582024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14592024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
14602024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14612024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
14622024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14632024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
14642024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
14652024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
14662024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
14672024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14682024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14692024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
14702024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
14712024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
14722024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14732024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
14742024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14752024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
14762024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14772024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
14782024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
14792024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
14802024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14812024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
14822024-11-07T22:46:50.819ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
14832024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14842024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
14852024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14862024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
14872024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14882024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
14892024-11-07T22:46:50.819ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531
14902024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
14912024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.691\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531"}
14922024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
14932024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14942024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
14952024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
14962024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14972024-11-07T22:46:50.819ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-07 22:36:50.819743395 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
14982024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14992024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
15002024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
15012024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
15022024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
15032024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15042024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15052024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
15062024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15072024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
15082024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
15092024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15102024-11-07T22:46:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15112024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15122024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15132024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15142024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
15152024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15162024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15172024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
15182024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15192024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15202024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15212024-11-07T22:46:50.820ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19da6a5b-073a-4e12-8775-91fc61c1e962.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 904, tv_nsec: 908546171 } })
15222024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15232024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15242024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15252024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15262024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
15272024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15282024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15292024-11-07T22:46:50.820ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a127151b-10b2-4835-91ce-b493ecd30481.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("de9282a1-0aa7-4ad8-a39a-58f19d05b651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 904, tv_nsec: 908727676 } })
15302024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15312024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
15322024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.144001ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
15332024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
15342024-11-07T22:46:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.181542ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
15352024-11-07T22:46:50.822ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.149665ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
15362024-11-07T22:46:50.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.619968ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
15372024-11-07T22:46:50.823ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 904, tv_nsec: 912144139 } })
15382024-11-07T22:46:50.824ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
15392024-11-07T22:46:50.824ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.715338ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15402024-11-07T22:46:50.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15412024-11-07T22:46:50.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15422024-11-07T22:46:50.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15432024-11-07T22:46:50.825ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15442024-11-07T22:46:50.825ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 904, tv_nsec: 913848614 } })
15452024-11-07T22:46:50.825ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
15462024-11-07T22:46:50.826ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15472024-11-07T22:46:50.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15482024-11-07T22:46:50.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15492024-11-07T22:46:50.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15502024-11-07T22:46:50.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15512024-11-07T22:46:50.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15522024-11-07T22:46:50.827ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
15532024-11-07T22:46:50.827ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
15542024-11-07T22:46:50.827ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 8.129819ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
15552024-11-07T22:46:50.829ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.98934ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
15562024-11-07T22:46:50.830ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15572024-11-07T22:46:50.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15582024-11-07T22:46:50.832ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15592024-11-07T22:46:50.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15602024-11-07T22:46:50.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15612024-11-07T22:46:50.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15622024-11-07T22:46:50.833ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15632024-11-07T22:46:50.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15642024-11-07T22:46:50.834ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15652024-11-07T22:46:50.834ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15662024-11-07T22:46:50.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15672024-11-07T22:46:50.835ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-07 22:36:50.819743395 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
15682024-11-07T22:46:50.835ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 16.162006ms iteration = 5 status = {"expiration":"2024-11-07T22:36:50.819743395Z","pruned":[]}
15692024-11-07T22:46:50.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
15702024-11-07T22:46:50.837ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15712024-11-07T22:46:50.837ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
15722024-11-07T22:46:50.837ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15732024-11-07T22:46:50.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15742024-11-07T22:46:50.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15752024-11-07T22:46:50.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15762024-11-07T22:46:50.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15772024-11-07T22:46:50.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15782024-11-07T22:46:50.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15792024-11-07T22:46:50.841ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15802024-11-07T22:46:50.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15812024-11-07T22:46:50.841ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15822024-11-07T22:46:50.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15832024-11-07T22:46:50.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15842024-11-07T22:46:50.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15852024-11-07T22:46:50.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15862024-11-07T22:46:50.845ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 904, tv_nsec: 933703080 } })
15872024-11-07T22:46:50.845ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15882024-11-07T22:46:50.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15892024-11-07T22:46:50.845ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
15902024-11-07T22:46:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15912024-11-07T22:46:50.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15922024-11-07T22:46:50.847ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
15932024-11-07T22:46:50.847ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
15942024-11-07T22:46:50.847ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
15952024-11-07T22:46:50.847ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15962024-11-07T22:46:50.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15972024-11-07T22:46:50.849ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15982024-11-07T22:46:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15992024-11-07T22:46:50.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16002024-11-07T22:46:50.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16012024-11-07T22:46:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16022024-11-07T22:46:50.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16032024-11-07T22:46:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16042024-11-07T22:46:50.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16052024-11-07T22:46:50.856ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
16062024-11-07T22:46:50.856ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
16072024-11-07T22:46:50.856ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
16082024-11-07T22:46:50.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16092024-11-07T22:46:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16102024-11-07T22:46:50.857ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16112024-11-07T22:46:50.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16122024-11-07T22:46:50.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16132024-11-07T22:46:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
16142024-11-07T22:46:50.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16152024-11-07T22:46:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16162024-11-07T22:46:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16172024-11-07T22:46:50.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16182024-11-07T22:46:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16192024-11-07T22:46:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
16202024-11-07T22:46:50.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16212024-11-07T22:46:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16222024-11-07T22:46:50.868ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16232024-11-07T22:46:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16242024-11-07T22:46:50.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16252024-11-07T22:46:50.869ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16262024-11-07T22:46:50.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16272024-11-07T22:46:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16282024-11-07T22:46:50.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16292024-11-07T22:46:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16302024-11-07T22:46:50.875ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16312024-11-07T22:46:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16322024-11-07T22:46:50.880ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16332024-11-07T22:46:50.880ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
16342024-11-07T22:46:50.880ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16352024-11-07T22:46:50.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16362024-11-07T22:46:50.880ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16372024-11-07T22:46:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16382024-11-07T22:46:50.882ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
16392024-11-07T22:46:50.882ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
16402024-11-07T22:46:50.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16412024-11-07T22:46:50.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16422024-11-07T22:46:50.883ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 63.846803ms iteration = 12 status = {"physical_disks_added":0}
16432024-11-07T22:46:50.884ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16442024-11-07T22:46:50.884ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
16452024-11-07T22:46:50.884ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16462024-11-07T22:46:50.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16472024-11-07T22:46:50.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16482024-11-07T22:46:50.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16492024-11-07T22:46:50.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16502024-11-07T22:46:50.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16512024-11-07T22:46:50.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16522024-11-07T22:46:50.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
16532024-11-07T22:46:50.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16542024-11-07T22:46:50.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16552024-11-07T22:46:50.891ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
16562024-11-07T22:46:50.891ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 71.989672ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
16572024-11-07T22:46:50.891ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16582024-11-07T22:46:50.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16592024-11-07T22:46:50.892ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16602024-11-07T22:46:50.892ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16612024-11-07T22:46:50.892ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 73.069622ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16622024-11-07T22:46:50.893ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
16632024-11-07T22:46:50.893ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
16642024-11-07T22:46:50.893ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-07 22:43:11.086261 UTC dns_group = internal generation = 1
16652024-11-07T22:46:50.893ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 73.572975ms iteration = 6 status = {"generation":1}
16662024-11-07T22:46:50.898ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
16672024-11-07T22:46:50.898ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 78.357665ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
16682024-11-07T22:46:50.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16692024-11-07T22:46:50.903ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
16702024-11-07T22:46:50.903ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
16712024-11-07T22:46:50.903ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 84.022998ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
16722024-11-07T22:46:50.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 84.749857ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16732024-11-07T22:46:50.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16742024-11-07T22:46:50.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16752024-11-07T22:46:50.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16762024-11-07T22:46:50.926ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16772024-11-07T22:46:50.928ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 108.964771ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
16782024-11-07T22:46:50.929ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16792024-11-07T22:46:50.930ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16802024-11-07T22:46:50.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16812024-11-07T22:46:50.934ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 114.909591ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16822024-11-07T22:46:50.935ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16832024-11-07T22:46:50.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16842024-11-07T22:46:50.938ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16852024-11-07T22:46:50.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16862024-11-07T22:46:50.939ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16872024-11-07T22:46:50.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16882024-11-07T22:46:50.941ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.484528ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
16892024-11-07T22:46:50.942ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16902024-11-07T22:46:50.944ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
16912024-11-07T22:46:50.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
16922024-11-07T22:46:50.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
16932024-11-07T22:46:50.946ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16942024-11-07T22:46:50.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16952024-11-07T22:46:50.952ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 132.779263ms iteration = 9 status = 0
16962024-11-07T22:46:50.959ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
16972024-11-07T22:46:50.959ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 0 version = 2
16982024-11-07T22:46:50.959ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16992024-11-07T22:46:50.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17002024-11-07T22:46:50.964ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
17012024-11-07T22:46:50.964ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17022024-11-07T22:46:50.965ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae2d5ff5-1f15-46d9-9c24-ecc4a773109b", "content-length": "26", "date": "Thu, 07 Nov 2024 22:46:50 GMT"} })
17032024-11-07T22:46:50.965ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17042024-11-07T22:46:50.967ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17052024-11-07T22:46:50.977ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
17062024-11-07T22:46:50.977ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17072024-11-07T22:46:50.977ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee004050-ce54-4fa8-bced-492579bee78d", "content-length": "26", "date": "Thu, 07 Nov 2024 22:46:50 GMT"} })
17082024-11-07T22:46:50.977ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17092024-11-07T22:46:50.982ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
17102024-11-07T22:46:50.997ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-07T22:42:48.907310Z, time_modified: 2024-11-07T22:42:48.907310Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }) }
17112024-11-07T22:46:50.997ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 178.143387ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]}},"default_endpoint":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
17122024-11-07T22:46:51.020ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17132024-11-07T22:46:51.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17142024-11-07T22:46:51.025ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17152024-11-07T22:46:51.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17162024-11-07T22:46:51.028ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 1 version = 2
17172024-11-07T22:46:51.028ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
17182024-11-07T22:46:51.028ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-07 22:43:11.643428 UTC dns_group = external generation = 2
17192024-11-07T22:46:51.028ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 208.776624ms iteration = 6 status = {"generation":2}
17202024-11-07T22:46:51.029ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
17212024-11-07T22:46:51.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17222024-11-07T22:46:51.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17232024-11-07T22:46:51.044ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17242024-11-07T22:46:51.049ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17252024-11-07T22:46:51.049ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17262024-11-07T22:46:51.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17272024-11-07T22:46:51.117ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
17282024-11-07T22:46:51.117ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 297.56245ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
17292024-11-07T22:46:51.138ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17302024-11-07T22:46:51.138ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17312024-11-07T22:46:51.138ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "107536c0-8b26-4924-bd14-b5e69c11921e", "content-length": "372", "date": "Thu, 07 Nov 2024 22:46:51 GMT"} })
17322024-11-07T22:46:51.138ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17332024-11-07T22:46:51.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17342024-11-07T22:46:51.140ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17352024-11-07T22:46:51.143ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17362024-11-07T22:46:51.143ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17372024-11-07T22:46:51.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17382024-11-07T22:46:51.153ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
17392024-11-07T22:46:51.153ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17402024-11-07T22:46:51.154ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ab04daa-01e0-4372-a346-cf301d0e40ba", "content-length": "26", "date": "Thu, 07 Nov 2024 22:46:50 GMT"} })
17412024-11-07T22:46:51.154ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17422024-11-07T22:46:51.156ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
17432024-11-07T22:46:51.156ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17442024-11-07T22:46:51.156ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17452024-11-07T22:46:51.156ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fb9e3fba-63ee-430c-b830-ce1e5eee823e", "date": "Thu, 07 Nov 2024 22:46:51 GMT"} })
17462024-11-07T22:46:51.156ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17472024-11-07T22:46:51.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17482024-11-07T22:46:51.158ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17492024-11-07T22:46:51.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17502024-11-07T22:46:51.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17512024-11-07T22:46:51.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17522024-11-07T22:46:51.165ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
17532024-11-07T22:46:51.165ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17542024-11-07T22:46:51.166ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2c4400d1-3bbe-429f-a915-48d64d7d1e11", "date": "Thu, 07 Nov 2024 22:46:51 GMT"} })
17552024-11-07T22:46:51.167ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 348.086333ms iteration = 10 status = {}
17562024-11-07T22:46:51.171ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
17572024-11-07T22:46:51.238ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
17582024-11-07T22:46:51.238ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e21598be-db87-4053-b4ff-2ffce87cb1d4", "date": "Thu, 07 Nov 2024 22:46:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17592024-11-07T22:46:51.238ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17602024-11-07T22:46:51.241ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ad59d602-9a0c-4a7c-822c-9a6e0223a133", "date": "Thu, 07 Nov 2024 22:46:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17612024-11-07T22:46:51.241ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17622024-11-07T22:46:51.242ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17632024-11-07T22:46:51.242ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 423.064246ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
17642024-11-07T22:46:51.285ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17652024-11-07T22:46:51.285ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee3e5488-bf00-49bc-bef5-e362b87f7d16", "content-length": "1", "date": "Thu, 07 Nov 2024 22:46:51 GMT"} })
17662024-11-07T22:46:51.288ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17672024-11-07T22:46:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17682024-11-07T22:46:51.290ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 471.379829ms iteration = 9 status = null
17692024-11-07T22:46:51.294ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 475.495171ms iteration = 9 status = {}
17702024-11-07T22:46:51.303ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
17712024-11-07T22:46:51.303ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "60ea3ccf-0c68-4606-aa1e-bd07e60e1a86", "content-length": "691", "date": "Thu, 07 Nov 2024 22:46:51 GMT"} })
17722024-11-07T22:46:51.303ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
17732024-11-07T22:46:51.303ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
17742024-11-07T22:46:51.303ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
17752024-11-07T22:46:51.304ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 485.153931ms iteration = 9 status = {}
17762024-11-07T22:46:51.318ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
17772024-11-07T22:46:51.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17782024-11-07T22:46:51.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17792024-11-07T22:46:51.351ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
17802024-11-07T22:46:51.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17812024-11-07T22:46:51.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17822024-11-07T22:46:51.355ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
17832024-11-07T22:46:51.355ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c0a1fcce-690c-4477-a3f4-21b0c728dd81", "date": "Thu, 07 Nov 2024 22:46:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
17842024-11-07T22:46:51.355ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
17852024-11-07T22:46:51.356ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "bc767bae-a44c-4e46-a16d-4a12d2261f8a", "date": "Thu, 07 Nov 2024 22:46:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
17862024-11-07T22:46:51.356ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
17872024-11-07T22:46:51.358ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "779c331b-804d-4c87-945a-9fdc2641455c", "date": "Thu, 07 Nov 2024 22:46:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
17882024-11-07T22:46:51.358ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
17892024-11-07T22:46:51.360ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
17902024-11-07T22:46:51.360ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 540.628679ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
17912024-11-07T22:46:51.363ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
17922024-11-07T22:46:51.363ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "edc93c0a-0668-458c-9f8a-169b2e67c675", "content-length": "134", "date": "Thu, 07 Nov 2024 22:46:51 GMT"} })
17932024-11-07T22:46:51.363ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
17942024-11-07T22:46:51.363ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
17952024-11-07T22:46:51.363ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17962024-11-07T22:46:51.363ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17972024-11-07T22:46:51.363ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17982024-11-07T22:46:51.363ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17992024-11-07T22:46:51.363ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18002024-11-07T22:46:51.363ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18012024-11-07T22:46:51.363ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18022024-11-07T22:46:51.363ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18032024-11-07T22:46:51.364ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
18042024-11-07T22:46:51.364ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18052024-11-07T22:46:51.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18062024-11-07T22:46:51.366ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18072024-11-07T22:46:51.366ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "783db115-64b8-4c6a-871c-e4f368e27400", "content-length": "2", "date": "Thu, 07 Nov 2024 22:46:51 GMT"} })
18082024-11-07T22:46:51.366ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18092024-11-07T22:46:51.367ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8580e72-da04-48b0-a8e4-8b97d7d5d40e", "content-length": "52", "date": "Thu, 07 Nov 2024 22:46:51 GMT"} })
18102024-11-07T22:46:51.367ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
18112024-11-07T22:46:51.367ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18122024-11-07T22:46:51.458ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4fce4c6f-9c16-44e6-b26f-0939475e5868", "date": "Thu, 07 Nov 2024 22:46:51 GMT"} })
18132024-11-07T22:46:51.458ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
18142024-11-07T22:46:51.458ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18152024-11-07T22:46:51.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a47194a6-9e59-430b-bea2-94b35ca54118 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18162024-11-07T22:46:51.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a47194a6-9e59-430b-bea2-94b35ca54118 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18172024-11-07T22:46:51.459ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9969800-42ab-4c65-ba92-08ccd7480e0a", "content-length": "682", "date": "Thu, 07 Nov 2024 22:46:51 GMT"} })
18182024-11-07T22:46:51.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18192024-11-07T22:46:51.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18202024-11-07T22:46:51.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a47194a6-9e59-430b-bea2-94b35ca54118 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18212024-11-07T22:46:51.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18222024-11-07T22:46:51.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18232024-11-07T22:46:51.467ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18242024-11-07T22:46:51.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18252024-11-07T22:46:51.469ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18262024-11-07T22:46:51.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18272024-11-07T22:46:51.477ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 658.305253ms iteration = 9 status = {}
18282024-11-07T22:46:51.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 422a9b1e-77ef-4f16-9981-080b6bfc201d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
18292024-11-07T22:46:51.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 422a9b1e-77ef-4f16-9981-080b6bfc201d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
18302024-11-07T22:46:51.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 422a9b1e-77ef-4f16-9981-080b6bfc201d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
18312024-11-07T22:46:51.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 61fea337-b418-4768-a53a-a371f27b21c1 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
18322024-11-07T22:46:51.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 61fea337-b418-4768-a53a-a371f27b21c1 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
18332024-11-07T22:46:51.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 61fea337-b418-4768-a53a-a371f27b21c1 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
18342024-11-07T22:46:51.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = dd053c41-95f7-41b0-9175-1766f20e64a4 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
18352024-11-07T22:46:51.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = dd053c41-95f7-41b0-9175-1766f20e64a4 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
18362024-11-07T22:46:51.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = dd053c41-95f7-41b0-9175-1766f20e64a4 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
18372024-11-07T22:46:52.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b088c56d-5f06-4ec4-8a20-b0607dba71e6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18382024-11-07T22:46:52.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b088c56d-5f06-4ec4-8a20-b0607dba71e6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18392024-11-07T22:46:52.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b088c56d-5f06-4ec4-8a20-b0607dba71e6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18402024-11-07T22:46:53.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9c26a7b1-f10e-454c-ad18-11c4caf2a108 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18412024-11-07T22:46:53.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9c26a7b1-f10e-454c-ad18-11c4caf2a108 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18422024-11-07T22:46:53.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2557 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9c26a7b1-f10e-454c-ad18-11c4caf2a108 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18432024-11-07T22:46:54.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 13d9b654-6016-4348-994b-323376d6662d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18442024-11-07T22:46:54.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 13d9b654-6016-4348-994b-323376d6662d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18452024-11-07T22:46:54.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2036 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 13d9b654-6016-4348-994b-323376d6662d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18462024-11-07T22:46:55.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fd5ed121-ee98-4b7c-9163-0dfc5908dcd9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18472024-11-07T22:46:55.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fd5ed121-ee98-4b7c-9163-0dfc5908dcd9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18482024-11-07T22:46:55.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fd5ed121-ee98-4b7c-9163-0dfc5908dcd9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18492024-11-07T22:46:56.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 53a9d498-a7ed-4fba-a89c-3f162e7af5fe roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18502024-11-07T22:46:56.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 53a9d498-a7ed-4fba-a89c-3f162e7af5fe resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18512024-11-07T22:46:56.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 53a9d498-a7ed-4fba-a89c-3f162e7af5fe response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18522024-11-07T22:46:57.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 38e0e6fd-d404-4c00-914c-49a2023fa9ec roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18532024-11-07T22:46:57.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 38e0e6fd-d404-4c00-914c-49a2023fa9ec resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18542024-11-07T22:46:57.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2908 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 38e0e6fd-d404-4c00-914c-49a2023fa9ec response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18552024-11-07T22:46:58.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 44f632f5-1995-4ae0-a05a-9a948a14dde6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18562024-11-07T22:46:58.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 44f632f5-1995-4ae0-a05a-9a948a14dde6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18572024-11-07T22:46:58.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2990 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 44f632f5-1995-4ae0-a05a-9a948a14dde6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18582024-11-07T22:46:59.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 550331f3-4411-45ff-8d04-16cf74ee4bbc roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18592024-11-07T22:46:59.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 550331f3-4411-45ff-8d04-16cf74ee4bbc resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18602024-11-07T22:46:59.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 550331f3-4411-45ff-8d04-16cf74ee4bbc response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18612024-11-07T22:47:00.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c5fe9ca9-466e-49fa-9f5a-917525f3a7ed roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18622024-11-07T22:47:00.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c5fe9ca9-466e-49fa-9f5a-917525f3a7ed resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18632024-11-07T22:47:00.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c5fe9ca9-466e-49fa-9f5a-917525f3a7ed response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18642024-11-07T22:47:00.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
18652024-11-07T22:47:00.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
18662024-11-07T22:47:00.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18672024-11-07T22:47:00.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18682024-11-07T22:47:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18692024-11-07T22:47:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18702024-11-07T22:47:00.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18712024-11-07T22:47:00.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18722024-11-07T22:47:00.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18732024-11-07T22:47:00.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.423559ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18742024-11-07T22:47:00.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18752024-11-07T22:47:00.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18762024-11-07T22:47:00.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18772024-11-07T22:47:00.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18782024-11-07T22:47:00.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18792024-11-07T22:47:00.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18802024-11-07T22:47:00.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
18812024-11-07T22:47:00.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18822024-11-07T22:47:00.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18832024-11-07T22:47:00.839ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
18842024-11-07T22:47:00.839ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.062661ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
18852024-11-07T22:47:01.655ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1376 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 4cc9a7d7-51b6-4e39-92f3-d874725ebe45 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
18862024-11-07T22:47:01.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b69a7f41-2716-40fd-b830-1db7a2362bc6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18872024-11-07T22:47:01.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b69a7f41-2716-40fd-b830-1db7a2362bc6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18882024-11-07T22:47:01.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2645 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b69a7f41-2716-40fd-b830-1db7a2362bc6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18892024-11-07T22:47:02.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b5a42096-9a50-416b-8fe5-63028a7e236f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18902024-11-07T22:47:02.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b5a42096-9a50-416b-8fe5-63028a7e236f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18912024-11-07T22:47:02.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b5a42096-9a50-416b-8fe5-63028a7e236f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18922024-11-07T22:47:03.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 35ddffea-c921-416c-8521-ac840224b76b roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18932024-11-07T22:47:03.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 35ddffea-c921-416c-8521-ac840224b76b resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18942024-11-07T22:47:03.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 35ddffea-c921-416c-8521-ac840224b76b response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18952024-11-07T22:47:04.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b675f12b-bc70-4588-b9ae-4c23b1e4e190 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18962024-11-07T22:47:04.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b675f12b-bc70-4588-b9ae-4c23b1e4e190 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18972024-11-07T22:47:04.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b675f12b-bc70-4588-b9ae-4c23b1e4e190 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18982024-11-07T22:47:05.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d1744694-c8bd-45be-9c53-96534ac473cd roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
18992024-11-07T22:47:05.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d1744694-c8bd-45be-9c53-96534ac473cd resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19002024-11-07T22:47:05.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2586 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d1744694-c8bd-45be-9c53-96534ac473cd response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19012024-11-07T22:47:06.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 10fa567d-129a-4369-ae30-ab1f42670726 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
19022024-11-07T22:47:06.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 10fa567d-129a-4369-ae30-ab1f42670726 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
19032024-11-07T22:47:06.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 10fa567d-129a-4369-ae30-ab1f42670726 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
19042024-11-07T22:47:06.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = b6dcf2d6-3261-420b-b269-6117a52e55bf roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
19052024-11-07T22:47:06.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = b6dcf2d6-3261-420b-b269-6117a52e55bf resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
19062024-11-07T22:47:06.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = b6dcf2d6-3261-420b-b269-6117a52e55bf response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
19072024-11-07T22:47:06.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8af56f36-1e8d-44fa-a7f8-858cc417ac30 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19082024-11-07T22:47:06.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8af56f36-1e8d-44fa-a7f8-858cc417ac30 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19092024-11-07T22:47:06.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8af56f36-1e8d-44fa-a7f8-858cc417ac30 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19102024-11-07T22:47:07.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 14a3a69d-1782-4097-8fe1-415c19e74cd1 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19112024-11-07T22:47:07.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 14a3a69d-1782-4097-8fe1-415c19e74cd1 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19122024-11-07T22:47:07.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 14a3a69d-1782-4097-8fe1-415c19e74cd1 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19132024-11-07T22:47:08.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4a8e4567-d01b-4d0d-af02-47e614cf6952 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19142024-11-07T22:47:08.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4a8e4567-d01b-4d0d-af02-47e614cf6952 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19152024-11-07T22:47:08.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4a8e4567-d01b-4d0d-af02-47e614cf6952 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19162024-11-07T22:47:09.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 22105a90-c516-4dc2-9e23-2d7814fb5f75 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19172024-11-07T22:47:09.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 22105a90-c516-4dc2-9e23-2d7814fb5f75 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19182024-11-07T22:47:09.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 22105a90-c516-4dc2-9e23-2d7814fb5f75 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19192024-11-07T22:47:10.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
19202024-11-07T22:47:10.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
19212024-11-07T22:47:10.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19222024-11-07T22:47:10.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19232024-11-07T22:47:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19242024-11-07T22:47:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19252024-11-07T22:47:10.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19262024-11-07T22:47:10.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19272024-11-07T22:47:10.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19282024-11-07T22:47:10.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.264525ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19292024-11-07T22:47:10.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19302024-11-07T22:47:10.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19312024-11-07T22:47:10.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19322024-11-07T22:47:10.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19332024-11-07T22:47:10.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19342024-11-07T22:47:10.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19352024-11-07T22:47:10.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
19362024-11-07T22:47:10.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19372024-11-07T22:47:10.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19382024-11-07T22:47:10.840ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
19392024-11-07T22:47:10.840ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.171852ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
19402024-11-07T22:47:10.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2ca37191-b5e0-4a57-a078-7f0198650d9f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19412024-11-07T22:47:10.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2ca37191-b5e0-4a57-a078-7f0198650d9f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19422024-11-07T22:47:10.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2ca37191-b5e0-4a57-a078-7f0198650d9f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19432024-11-07T22:47:11.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d6fe303f-51c6-474f-aadd-b2af223c4680 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19442024-11-07T22:47:11.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d6fe303f-51c6-474f-aadd-b2af223c4680 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19452024-11-07T22:47:11.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2054 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d6fe303f-51c6-474f-aadd-b2af223c4680 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19462024-11-07T22:47:12.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 349e4945-8f8a-4a35-98a8-1223ff233a30 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19472024-11-07T22:47:12.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 349e4945-8f8a-4a35-98a8-1223ff233a30 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19482024-11-07T22:47:12.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2586 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 349e4945-8f8a-4a35-98a8-1223ff233a30 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19492024-11-07T22:47:13.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = aafcddc7-d06f-4e8e-8458-1e1ed8b3a13f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19502024-11-07T22:47:13.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = aafcddc7-d06f-4e8e-8458-1e1ed8b3a13f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19512024-11-07T22:47:13.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = aafcddc7-d06f-4e8e-8458-1e1ed8b3a13f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19522024-11-07T22:47:14.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bc9addd8-0a25-4806-9424-256d9628ad4f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19532024-11-07T22:47:14.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bc9addd8-0a25-4806-9424-256d9628ad4f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19542024-11-07T22:47:14.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bc9addd8-0a25-4806-9424-256d9628ad4f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19552024-11-07T22:47:15.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ebc78a40-cd8c-40bd-a89a-ec72cd5387e4 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19562024-11-07T22:47:15.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ebc78a40-cd8c-40bd-a89a-ec72cd5387e4 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19572024-11-07T22:47:15.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ebc78a40-cd8c-40bd-a89a-ec72cd5387e4 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19582024-11-07T22:47:16.654ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1472 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 00392f71-3fbe-4d97-9f84-9f584089b90e response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
19592024-11-07T22:47:17.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 75fe4974-62d0-40da-aef8-067872bb3d29 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19602024-11-07T22:47:17.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 75fe4974-62d0-40da-aef8-067872bb3d29 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19612024-11-07T22:47:17.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2631 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 75fe4974-62d0-40da-aef8-067872bb3d29 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19622024-11-07T22:47:18.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 08b8c987-7359-464b-84ab-0a4cbf270763 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19632024-11-07T22:47:18.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 08b8c987-7359-464b-84ab-0a4cbf270763 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19642024-11-07T22:47:18.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2669 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 08b8c987-7359-464b-84ab-0a4cbf270763 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19652024-11-07T22:47:19.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3b3a66ea-ee14-47fb-af8a-45c68a8cedba roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19662024-11-07T22:47:19.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3b3a66ea-ee14-47fb-af8a-45c68a8cedba resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19672024-11-07T22:47:19.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3b3a66ea-ee14-47fb-af8a-45c68a8cedba response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19682024-11-07T22:47:20.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 269abacf-584a-420c-ae73-04a24faf106d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19692024-11-07T22:47:20.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 269abacf-584a-420c-ae73-04a24faf106d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19702024-11-07T22:47:20.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 269abacf-584a-420c-ae73-04a24faf106d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
19712024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
19722024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
19732024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19742024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19752024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
19762024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19772024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
19782024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19792024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
19802024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19812024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
19822024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
19832024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
19842024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19852024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
19862024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
19872024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
19882024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19892024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19902024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
19912024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
19922024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19932024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19942024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
19952024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
19962024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
19972024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19982024-11-07T22:47:20.819ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
19992024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20002024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
20012024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
20022024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20032024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
20042024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
20052024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20062024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20072024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20082024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
20092024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20102024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20112024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20122024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20132024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
20142024-11-07T22:47:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20152024-11-07T22:47:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20162024-11-07T22:47:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20172024-11-07T22:47:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20182024-11-07T22:47:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20192024-11-07T22:47:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20202024-11-07T22:47:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20212024-11-07T22:47:20.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
20222024-11-07T22:47:20.821ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20232024-11-07T22:47:20.823ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.748492ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20242024-11-07T22:47:20.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20252024-11-07T22:47:20.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20262024-11-07T22:47:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20272024-11-07T22:47:20.824ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20282024-11-07T22:47:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20292024-11-07T22:47:20.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20302024-11-07T22:47:20.826ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 934, tv_nsec: 915559681 } })
20312024-11-07T22:47:20.826ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
20322024-11-07T22:47:20.827ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20332024-11-07T22:47:20.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20342024-11-07T22:47:20.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20352024-11-07T22:47:20.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20362024-11-07T22:47:20.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20372024-11-07T22:47:20.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20382024-11-07T22:47:20.830ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20392024-11-07T22:47:20.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20402024-11-07T22:47:20.830ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20412024-11-07T22:47:20.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
20422024-11-07T22:47:20.830ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20432024-11-07T22:47:20.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20442024-11-07T22:47:20.831ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20452024-11-07T22:47:20.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20462024-11-07T22:47:20.831ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20472024-11-07T22:47:20.833ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20482024-11-07T22:47:20.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20492024-11-07T22:47:20.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20502024-11-07T22:47:20.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20512024-11-07T22:47:20.833ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20522024-11-07T22:47:20.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20532024-11-07T22:47:20.835ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20542024-11-07T22:47:20.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20552024-11-07T22:47:20.835ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 934, tv_nsec: 924652526 } })
20562024-11-07T22:47:20.835ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
20572024-11-07T22:47:20.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20582024-11-07T22:47:20.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20592024-11-07T22:47:20.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20602024-11-07T22:47:20.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20612024-11-07T22:47:20.837ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 934, tv_nsec: 926971989 } })
20622024-11-07T22:47:20.838ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
20632024-11-07T22:47:20.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20642024-11-07T22:47:20.839ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20652024-11-07T22:47:20.839ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20662024-11-07T22:47:20.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20672024-11-07T22:47:20.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20682024-11-07T22:47:20.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20692024-11-07T22:47:20.840ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20702024-11-07T22:47:20.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20712024-11-07T22:47:20.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20722024-11-07T22:47:20.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
20732024-11-07T22:47:20.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20742024-11-07T22:47:20.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20752024-11-07T22:47:20.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20762024-11-07T22:47:20.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20772024-11-07T22:47:20.857ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20782024-11-07T22:47:20.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20792024-11-07T22:47:20.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20802024-11-07T22:47:20.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20812024-11-07T22:47:20.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
20822024-11-07T22:47:20.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.519707ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
20832024-11-07T22:47:20.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.925894ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
20842024-11-07T22:47:20.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.027077ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
20852024-11-07T22:47:20.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20862024-11-07T22:47:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20872024-11-07T22:47:20.873ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20882024-11-07T22:47:20.873ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20892024-11-07T22:47:20.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20902024-11-07T22:47:20.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20912024-11-07T22:47:20.874ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20922024-11-07T22:47:20.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20932024-11-07T22:47:20.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20942024-11-07T22:47:20.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
20952024-11-07T22:47:20.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20962024-11-07T22:47:20.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20972024-11-07T22:47:20.881ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20982024-11-07T22:47:20.881ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.965942ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20992024-11-07T22:47:20.882ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21002024-11-07T22:47:20.882ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 62.709262ms iteration = 10 status = 0
21012024-11-07T22:47:20.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21022024-11-07T22:47:20.883ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21032024-11-07T22:47:20.884ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21042024-11-07T22:47:20.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21052024-11-07T22:47:20.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21062024-11-07T22:47:20.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21072024-11-07T22:47:20.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21082024-11-07T22:47:20.887ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 68.454117ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21092024-11-07T22:47:20.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 74.286945ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
21102024-11-07T22:47:20.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 78.974541ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21112024-11-07T22:47:20.912ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21122024-11-07T22:47:20.916ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21132024-11-07T22:47:20.916ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21142024-11-07T22:47:20.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21152024-11-07T22:47:20.923ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21162024-11-07T22:47:20.923ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
21172024-11-07T22:47:20.923ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21182024-11-07T22:47:20.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21192024-11-07T22:47:20.926ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
21202024-11-07T22:47:20.926ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21212024-11-07T22:47:20.926ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cc667df-d815-4ef3-96c6-40e8c4defa6c", "content-length": "26", "date": "Thu, 07 Nov 2024 22:47:20 GMT"} })
21222024-11-07T22:47:20.926ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21232024-11-07T22:47:20.928ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21242024-11-07T22:47:20.929ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 110.123942ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
21252024-11-07T22:47:20.944ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 125.25565ms iteration = 13 status = {"physical_disks_added":0}
21262024-11-07T22:47:20.963ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
21272024-11-07T22:47:20.963ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21282024-11-07T22:47:20.963ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb1d73ac-faae-4dba-b8a8-fad75aac63e1", "content-length": "26", "date": "Thu, 07 Nov 2024 22:47:20 GMT"} })
21292024-11-07T22:47:20.964ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21302024-11-07T22:47:20.966ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21312024-11-07T22:47:20.969ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21322024-11-07T22:47:20.969ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
21332024-11-07T22:47:20.969ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 150.101221ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
21342024-11-07T22:47:20.978ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
21352024-11-07T22:47:20.978ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21362024-11-07T22:47:20.980ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f88447b-7690-446d-b646-23b473155dcb", "content-length": "26", "date": "Thu, 07 Nov 2024 22:47:20 GMT"} })
21372024-11-07T22:47:20.980ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21382024-11-07T22:47:20.985ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
21392024-11-07T22:47:21.076ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21402024-11-07T22:47:21.077ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d81af16-f699-480f-aa13-abe5f45696b6", "content-length": "691", "date": "Thu, 07 Nov 2024 22:47:21 GMT"} })
21412024-11-07T22:47:21.077ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
21422024-11-07T22:47:21.077ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
21432024-11-07T22:47:21.077ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
21442024-11-07T22:47:21.079ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 259.895503ms iteration = 10 status = {}
21452024-11-07T22:47:21.089ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
21462024-11-07T22:47:21.089ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21472024-11-07T22:47:21.090ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ab8a4bc-86d8-462e-b1af-39f6c316ed35", "content-length": "372", "date": "Thu, 07 Nov 2024 22:47:21 GMT"} })
21482024-11-07T22:47:21.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21492024-11-07T22:47:21.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21502024-11-07T22:47:21.091ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
21512024-11-07T22:47:21.091ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7c997b5-4ba7-4e92-bb8e-e5fac80b2232", "content-length": "1", "date": "Thu, 07 Nov 2024 22:47:20 GMT"} })
21522024-11-07T22:47:21.093ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21532024-11-07T22:47:21.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21542024-11-07T22:47:21.095ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 276.10008ms iteration = 10 status = null
21552024-11-07T22:47:21.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8f538c45-4a66-4ade-8512-3e2cc09fdb9c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21562024-11-07T22:47:21.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8f538c45-4a66-4ade-8512-3e2cc09fdb9c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21572024-11-07T22:47:21.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2364 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8f538c45-4a66-4ade-8512-3e2cc09fdb9c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
21582024-11-07T22:47:21.111ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
21592024-11-07T22:47:21.111ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
21602024-11-07T22:47:21.117ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "dd387288-e8a0-4181-bc69-b10c2878aff3", "date": "Thu, 07 Nov 2024 22:47:21 GMT"} })
21612024-11-07T22:47:21.117ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21622024-11-07T22:47:21.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21632024-11-07T22:47:21.119ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21642024-11-07T22:47:21.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21652024-11-07T22:47:21.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21662024-11-07T22:47:21.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21672024-11-07T22:47:21.126ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
21682024-11-07T22:47:21.126ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21692024-11-07T22:47:21.126ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "720688fc-309c-4725-80e4-a8c6e08315f8", "date": "Thu, 07 Nov 2024 22:47:21 GMT"} })
21702024-11-07T22:47:21.127ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 308.382512ms iteration = 11 status = {}
21712024-11-07T22:47:21.143ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 323.665374ms iteration = 10 status = {}
21722024-11-07T22:47:21.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21732024-11-07T22:47:21.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21742024-11-07T22:47:21.217ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
21752024-11-07T22:47:21.217ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21762024-11-07T22:47:21.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21772024-11-07T22:47:21.226ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
21782024-11-07T22:47:21.226ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4ff1730-44d9-44ab-91a4-89ee0dd04c8d", "content-length": "134", "date": "Thu, 07 Nov 2024 22:47:20 GMT"} })
21792024-11-07T22:47:21.226ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
21802024-11-07T22:47:21.226ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
21812024-11-07T22:47:21.226ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
21822024-11-07T22:47:21.226ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
21832024-11-07T22:47:21.226ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21842024-11-07T22:47:21.226ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21852024-11-07T22:47:21.226ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21862024-11-07T22:47:21.226ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21872024-11-07T22:47:21.226ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21882024-11-07T22:47:21.226ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21892024-11-07T22:47:21.227ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
21902024-11-07T22:47:21.227ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21912024-11-07T22:47:21.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21922024-11-07T22:47:21.229ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
21932024-11-07T22:47:21.229ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ed984ce-290b-465c-8e60-9eac87f754ab", "content-length": "2", "date": "Thu, 07 Nov 2024 22:47:20 GMT"} })
21942024-11-07T22:47:21.229ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
21952024-11-07T22:47:21.229ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "df3a2fe8-6c9f-41ee-a026-39e207947242", "content-length": "52", "date": "Thu, 07 Nov 2024 22:47:20 GMT"} })
21962024-11-07T22:47:21.229ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
21972024-11-07T22:47:21.229ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
21982024-11-07T22:47:21.396ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5e73f397-a773-41d9-949a-0cc7b0d555b4", "date": "Thu, 07 Nov 2024 22:47:21 GMT"} })
21992024-11-07T22:47:21.396ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
22002024-11-07T22:47:21.396ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
22012024-11-07T22:47:21.400ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce5cbccc-3a44-4567-930a-c95316ad68dd", "content-length": "682", "date": "Thu, 07 Nov 2024 22:47:21 GMT"} })
22022024-11-07T22:47:21.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22032024-11-07T22:47:21.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22042024-11-07T22:47:21.404ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22052024-11-07T22:47:21.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22062024-11-07T22:47:21.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22072024-11-07T22:47:21.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22082024-11-07T22:47:21.409ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22092024-11-07T22:47:21.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22102024-11-07T22:47:21.416ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 597.576365ms iteration = 10 status = {}
22112024-11-07T22:47:21.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 49925d58-9761-453e-8724-3aaca84e18e5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
22122024-11-07T22:47:21.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 49925d58-9761-453e-8724-3aaca84e18e5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
22132024-11-07T22:47:21.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3441 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 49925d58-9761-453e-8724-3aaca84e18e5 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
22142024-11-07T22:47:21.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 269f1482-2ea2-4f9b-ab79-0a0eaec206a0 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
22152024-11-07T22:47:21.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 269f1482-2ea2-4f9b-ab79-0a0eaec206a0 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
22162024-11-07T22:47:21.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2545 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 269f1482-2ea2-4f9b-ab79-0a0eaec206a0 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
22172024-11-07T22:47:21.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 4ba0ecfe-d8cd-4613-bc98-b821884617bb roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
22182024-11-07T22:47:21.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 4ba0ecfe-d8cd-4613-bc98-b821884617bb resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
22192024-11-07T22:47:21.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1666 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 4ba0ecfe-d8cd-4613-bc98-b821884617bb response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
22202024-11-07T22:47:22.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 00c5c229-948b-480b-a7e5-efc8321119f2 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22212024-11-07T22:47:22.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 00c5c229-948b-480b-a7e5-efc8321119f2 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22222024-11-07T22:47:22.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1897 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 00c5c229-948b-480b-a7e5-efc8321119f2 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22232024-11-07T22:47:23.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cc854f6f-0341-4927-bd21-8672eba0af5a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22242024-11-07T22:47:23.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cc854f6f-0341-4927-bd21-8672eba0af5a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22252024-11-07T22:47:23.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cc854f6f-0341-4927-bd21-8672eba0af5a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22262024-11-07T22:47:24.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7946b263-5378-4fdc-8a20-0f0cb3594fa1 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22272024-11-07T22:47:24.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7946b263-5378-4fdc-8a20-0f0cb3594fa1 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22282024-11-07T22:47:24.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1942 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7946b263-5378-4fdc-8a20-0f0cb3594fa1 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22292024-11-07T22:47:25.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 41fe5a85-8ffd-4cf2-ae69-33c20033896b roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22302024-11-07T22:47:25.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 41fe5a85-8ffd-4cf2-ae69-33c20033896b resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22312024-11-07T22:47:25.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1645 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 41fe5a85-8ffd-4cf2-ae69-33c20033896b response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22322024-11-07T22:47:26.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 48bc84c4-2e1e-4b26-b482-4207d3973036 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22332024-11-07T22:47:26.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 48bc84c4-2e1e-4b26-b482-4207d3973036 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22342024-11-07T22:47:26.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 48bc84c4-2e1e-4b26-b482-4207d3973036 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22352024-11-07T22:47:27.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a806c35c-035f-4106-841e-3f00df363d58 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22362024-11-07T22:47:27.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a806c35c-035f-4106-841e-3f00df363d58 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22372024-11-07T22:47:27.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a806c35c-035f-4106-841e-3f00df363d58 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22382024-11-07T22:47:28.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bea4290b-6943-418f-b8d1-b0c8eb3c1f58 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22392024-11-07T22:47:28.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bea4290b-6943-418f-b8d1-b0c8eb3c1f58 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22402024-11-07T22:47:28.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2564 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bea4290b-6943-418f-b8d1-b0c8eb3c1f58 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22412024-11-07T22:47:29.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 94adc2d2-4cdf-4777-9b43-bbd66c1b6b55 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22422024-11-07T22:47:29.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 94adc2d2-4cdf-4777-9b43-bbd66c1b6b55 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22432024-11-07T22:47:29.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 94adc2d2-4cdf-4777-9b43-bbd66c1b6b55 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22442024-11-07T22:47:30.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fea60992-f17f-4e6b-86db-ee5f13839731 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22452024-11-07T22:47:30.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fea60992-f17f-4e6b-86db-ee5f13839731 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22462024-11-07T22:47:30.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fea60992-f17f-4e6b-86db-ee5f13839731 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22472024-11-07T22:47:30.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
22482024-11-07T22:47:30.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
22492024-11-07T22:47:30.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22502024-11-07T22:47:30.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22512024-11-07T22:47:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22522024-11-07T22:47:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22532024-11-07T22:47:30.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22542024-11-07T22:47:30.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22552024-11-07T22:47:30.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22562024-11-07T22:47:30.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.788979ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22572024-11-07T22:47:30.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22582024-11-07T22:47:30.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22592024-11-07T22:47:30.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22602024-11-07T22:47:30.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22612024-11-07T22:47:30.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22622024-11-07T22:47:30.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22632024-11-07T22:47:30.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
22642024-11-07T22:47:30.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22652024-11-07T22:47:30.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22662024-11-07T22:47:30.838ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
22672024-11-07T22:47:30.838ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.448325ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
22682024-11-07T22:47:31.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f1a97f47-9c2b-495b-aa9f-6e0d36d02995 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22692024-11-07T22:47:31.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f1a97f47-9c2b-495b-aa9f-6e0d36d02995 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22702024-11-07T22:47:31.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f1a97f47-9c2b-495b-aa9f-6e0d36d02995 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22712024-11-07T22:47:31.652ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1249 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = f9d47111-d687-4322-acbc-54b06958e80b response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
22722024-11-07T22:47:32.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 54abdbdf-6741-4dc6-b9f1-8a8e6e4ca1bd roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22732024-11-07T22:47:32.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 54abdbdf-6741-4dc6-b9f1-8a8e6e4ca1bd resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22742024-11-07T22:47:32.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 54abdbdf-6741-4dc6-b9f1-8a8e6e4ca1bd response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22752024-11-07T22:47:33.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8c6c53ec-159c-4388-8dda-fd133240c3c4 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22762024-11-07T22:47:33.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8c6c53ec-159c-4388-8dda-fd133240c3c4 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22772024-11-07T22:47:33.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1742 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8c6c53ec-159c-4388-8dda-fd133240c3c4 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22782024-11-07T22:47:34.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8b085f39-33a9-46b6-af8a-c33412e5b688 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22792024-11-07T22:47:34.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8b085f39-33a9-46b6-af8a-c33412e5b688 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22802024-11-07T22:47:34.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8b085f39-33a9-46b6-af8a-c33412e5b688 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22812024-11-07T22:47:35.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 93266569-d66b-44ea-b712-40d02991d9b1 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22822024-11-07T22:47:35.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 93266569-d66b-44ea-b712-40d02991d9b1 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22832024-11-07T22:47:35.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2722 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 93266569-d66b-44ea-b712-40d02991d9b1 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22842024-11-07T22:47:36.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4664ceac-b4ab-4d21-afe6-d8cf59c6dd10 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22852024-11-07T22:47:36.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4664ceac-b4ab-4d21-afe6-d8cf59c6dd10 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22862024-11-07T22:47:36.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2784 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4664ceac-b4ab-4d21-afe6-d8cf59c6dd10 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22872024-11-07T22:47:37.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5dcf34d0-b919-4bc2-8c5c-a9af44c946d6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22882024-11-07T22:47:37.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5dcf34d0-b919-4bc2-8c5c-a9af44c946d6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22892024-11-07T22:47:37.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5dcf34d0-b919-4bc2-8c5c-a9af44c946d6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22902024-11-07T22:47:38.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b7811de1-c599-468d-a367-f2b66374f411 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22912024-11-07T22:47:38.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b7811de1-c599-468d-a367-f2b66374f411 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22922024-11-07T22:47:38.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2150 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b7811de1-c599-468d-a367-f2b66374f411 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22932024-11-07T22:47:39.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6e6efcfe-3dc2-401d-ae1b-9ab9b368700a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22942024-11-07T22:47:39.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6e6efcfe-3dc2-401d-ae1b-9ab9b368700a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22952024-11-07T22:47:39.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2081 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6e6efcfe-3dc2-401d-ae1b-9ab9b368700a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22962024-11-07T22:47:40.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1a96c8f0-6113-4318-a078-1596e8dab41c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22972024-11-07T22:47:40.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1a96c8f0-6113-4318-a078-1596e8dab41c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22982024-11-07T22:47:40.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1a96c8f0-6113-4318-a078-1596e8dab41c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
22992024-11-07T22:47:40.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
23002024-11-07T22:47:40.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23012024-11-07T22:47:40.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
23022024-11-07T22:47:40.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23032024-11-07T22:47:40.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23042024-11-07T22:47:40.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23052024-11-07T22:47:40.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23062024-11-07T22:47:40.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23072024-11-07T22:47:40.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23082024-11-07T22:47:40.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.982838ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23092024-11-07T22:47:40.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23102024-11-07T22:47:40.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23112024-11-07T22:47:40.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23122024-11-07T22:47:40.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23132024-11-07T22:47:40.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23142024-11-07T22:47:40.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23152024-11-07T22:47:40.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
23162024-11-07T22:47:40.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23172024-11-07T22:47:40.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23182024-11-07T22:47:40.838ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
23192024-11-07T22:47:40.838ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.730542ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
23202024-11-07T22:47:41.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9d52c6bb-a659-4395-9935-f79b018016cb roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23212024-11-07T22:47:41.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9d52c6bb-a659-4395-9935-f79b018016cb resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23222024-11-07T22:47:41.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9d52c6bb-a659-4395-9935-f79b018016cb response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23232024-11-07T22:47:42.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4010dbb6-6d86-4dff-bbd0-fbaf3c560102 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23242024-11-07T22:47:42.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4010dbb6-6d86-4dff-bbd0-fbaf3c560102 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23252024-11-07T22:47:42.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4010dbb6-6d86-4dff-bbd0-fbaf3c560102 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23262024-11-07T22:47:43.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7c50c03f-a59f-4b90-8ab7-e9859e1d5f90 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23272024-11-07T22:47:43.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7c50c03f-a59f-4b90-8ab7-e9859e1d5f90 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23282024-11-07T22:47:43.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7c50c03f-a59f-4b90-8ab7-e9859e1d5f90 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23292024-11-07T22:47:44.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 30b613b6-ce3a-4ffe-8b37-e0cc0ea6decf roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23302024-11-07T22:47:44.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 30b613b6-ce3a-4ffe-8b37-e0cc0ea6decf resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23312024-11-07T22:47:44.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 30b613b6-ce3a-4ffe-8b37-e0cc0ea6decf response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23322024-11-07T22:47:45.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ef45e08b-56a1-41f7-bbb8-c8dc6ce22369 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23332024-11-07T22:47:45.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ef45e08b-56a1-41f7-bbb8-c8dc6ce22369 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23342024-11-07T22:47:45.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ef45e08b-56a1-41f7-bbb8-c8dc6ce22369 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23352024-11-07T22:47:46.654ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2462 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 8be5df53-f216-4343-91eb-6f1771a8d48d response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
23362024-11-07T22:47:46.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 623b9d38-ed9c-4d16-a173-efd5f0b58e05 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23372024-11-07T22:47:46.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 623b9d38-ed9c-4d16-a173-efd5f0b58e05 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23382024-11-07T22:47:46.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2289 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 623b9d38-ed9c-4d16-a173-efd5f0b58e05 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23392024-11-07T22:47:47.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ad57bec9-0753-41a1-803e-7d6c1530fcae roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23402024-11-07T22:47:47.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ad57bec9-0753-41a1-803e-7d6c1530fcae resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23412024-11-07T22:47:47.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2851 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ad57bec9-0753-41a1-803e-7d6c1530fcae response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23422024-11-07T22:47:48.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ca24276c-762c-4135-b9fc-309f4bc4d993 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23432024-11-07T22:47:48.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ca24276c-762c-4135-b9fc-309f4bc4d993 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23442024-11-07T22:47:48.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1998 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ca24276c-762c-4135-b9fc-309f4bc4d993 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23452024-11-07T22:47:49.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fb7d08d5-fbec-4bb3-b665-d806697e55df roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23462024-11-07T22:47:49.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fb7d08d5-fbec-4bb3-b665-d806697e55df resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23472024-11-07T22:47:49.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fb7d08d5-fbec-4bb3-b665-d806697e55df response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23482024-11-07T22:47:50.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8dffda02-3594-4fa2-ac50-2b4e7dad7b2d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23492024-11-07T22:47:50.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8dffda02-3594-4fa2-ac50-2b4e7dad7b2d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23502024-11-07T22:47:50.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8dffda02-3594-4fa2-ac50-2b4e7dad7b2d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
23512024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
23522024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
23532024-11-07T22:47:50.818ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
23542024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
23552024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
23562024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23572024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
23582024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23592024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
23602024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23612024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
23622024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23632024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
23642024-11-07T22:47:50.818ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
23652024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
23662024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23672024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23682024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
23692024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23702024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
23712024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
23722024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23732024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
23742024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
23752024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
23762024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
23772024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23782024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
23792024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23802024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
23812024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
23822024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
23832024-11-07T22:47:50.818ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531
23842024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.97\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531"}
23852024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
23862024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23872024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
23882024-11-07T22:47:50.818ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-07 22:37:50.818768840 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
23892024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
23902024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
23912024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
23922024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
23932024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23942024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23952024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
23962024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
23972024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23982024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
23992024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
24002024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24012024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
24022024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
24032024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
24042024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
24052024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
24062024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
24072024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
24082024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
24092024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24102024-11-07T22:47:50.818ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
24112024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24122024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
24132024-11-07T22:47:50.819ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
24142024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24152024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
24162024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24172024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24182024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24192024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
24202024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24212024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24222024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24232024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24242024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24252024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24262024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24272024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24282024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
24292024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24302024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24312024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
24322024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
24332024-11-07T22:47:50.819ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19da6a5b-073a-4e12-8775-91fc61c1e962.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 964, tv_nsec: 908549942 } })
24342024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24352024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24362024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24372024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24382024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24392024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24402024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24412024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24422024-11-07T22:47:50.819ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a127151b-10b2-4835-91ce-b493ecd30481.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("de9282a1-0aa7-4ad8-a39a-58f19d05b651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 964, tv_nsec: 908626313 } })
24432024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
24442024-11-07T22:47:50.819ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.016157ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
24452024-11-07T22:47:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
24462024-11-07T22:47:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.335666ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
24472024-11-07T22:47:50.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24482024-11-07T22:47:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24492024-11-07T22:47:50.822ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.664129ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24502024-11-07T22:47:50.822ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24512024-11-07T22:47:50.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24522024-11-07T22:47:50.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24532024-11-07T22:47:50.823ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
24542024-11-07T22:47:50.823ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
24552024-11-07T22:47:50.823ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 4.915743ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
24562024-11-07T22:47:50.823ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24572024-11-07T22:47:50.825ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.525996ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
24582024-11-07T22:47:50.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24592024-11-07T22:47:50.825ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24602024-11-07T22:47:50.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24612024-11-07T22:47:50.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24622024-11-07T22:47:50.826ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24632024-11-07T22:47:50.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24642024-11-07T22:47:50.826ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24652024-11-07T22:47:50.826ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24662024-11-07T22:47:50.826ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24672024-11-07T22:47:50.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24682024-11-07T22:47:50.828ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.333612ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
24692024-11-07T22:47:50.828ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24702024-11-07T22:47:50.828ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24712024-11-07T22:47:50.829ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-07 22:37:50.818768840 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
24722024-11-07T22:47:50.829ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.083989ms iteration = 6 status = {"expiration":"2024-11-07T22:37:50.818768840Z","pruned":[]}
24732024-11-07T22:47:50.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
24742024-11-07T22:47:50.831ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24752024-11-07T22:47:50.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24762024-11-07T22:47:50.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24772024-11-07T22:47:50.831ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24782024-11-07T22:47:50.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24792024-11-07T22:47:50.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24802024-11-07T22:47:50.833ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24812024-11-07T22:47:50.834ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24822024-11-07T22:47:50.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24832024-11-07T22:47:50.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24842024-11-07T22:47:50.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24852024-11-07T22:47:50.835ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24862024-11-07T22:47:50.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24872024-11-07T22:47:50.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24882024-11-07T22:47:50.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24892024-11-07T22:47:50.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24902024-11-07T22:47:50.836ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24912024-11-07T22:47:50.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24922024-11-07T22:47:50.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24932024-11-07T22:47:50.837ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24942024-11-07T22:47:50.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24952024-11-07T22:47:50.838ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 964, tv_nsec: 927162864 } })
24962024-11-07T22:47:50.838ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
24972024-11-07T22:47:50.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24982024-11-07T22:47:50.839ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 964, tv_nsec: 928521450 } })
24992024-11-07T22:47:50.839ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
25002024-11-07T22:47:50.840ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25012024-11-07T22:47:50.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25022024-11-07T22:47:50.840ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25032024-11-07T22:47:50.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25042024-11-07T22:47:50.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25052024-11-07T22:47:50.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25062024-11-07T22:47:50.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25072024-11-07T22:47:50.844ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25082024-11-07T22:47:50.844ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
25092024-11-07T22:47:50.844ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
25102024-11-07T22:47:50.844ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
25112024-11-07T22:47:50.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25122024-11-07T22:47:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25132024-11-07T22:47:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25142024-11-07T22:47:50.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25152024-11-07T22:47:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25162024-11-07T22:47:50.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25172024-11-07T22:47:50.845ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25182024-11-07T22:47:50.846ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25192024-11-07T22:47:50.847ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25202024-11-07T22:47:50.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25212024-11-07T22:47:50.850ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25222024-11-07T22:47:50.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25232024-11-07T22:47:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25242024-11-07T22:47:50.852ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25252024-11-07T22:47:50.852ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 34.126291ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25262024-11-07T22:47:50.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25272024-11-07T22:47:50.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
25282024-11-07T22:47:50.854ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25292024-11-07T22:47:50.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25302024-11-07T22:47:50.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25312024-11-07T22:47:50.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25322024-11-07T22:47:50.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25332024-11-07T22:47:50.858ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25342024-11-07T22:47:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25352024-11-07T22:47:50.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25362024-11-07T22:47:50.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25372024-11-07T22:47:50.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25382024-11-07T22:47:50.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25392024-11-07T22:47:50.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25402024-11-07T22:47:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25412024-11-07T22:47:50.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25422024-11-07T22:47:50.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
25432024-11-07T22:47:50.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25442024-11-07T22:47:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25452024-11-07T22:47:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25462024-11-07T22:47:50.865ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25472024-11-07T22:47:50.865ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25482024-11-07T22:47:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25492024-11-07T22:47:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25502024-11-07T22:47:50.870ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25512024-11-07T22:47:50.871ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 52.314572ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
25522024-11-07T22:47:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
25532024-11-07T22:47:50.874ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25542024-11-07T22:47:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25552024-11-07T22:47:50.877ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25562024-11-07T22:47:50.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25572024-11-07T22:47:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25582024-11-07T22:47:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25592024-11-07T22:47:50.885ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25602024-11-07T22:47:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25612024-11-07T22:47:50.887ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.392165ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
25622024-11-07T22:47:50.888ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
25632024-11-07T22:47:50.888ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
25642024-11-07T22:47:50.888ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 70.03607ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
25652024-11-07T22:47:50.888ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25662024-11-07T22:47:50.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
25672024-11-07T22:47:50.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25682024-11-07T22:47:50.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25692024-11-07T22:47:50.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25702024-11-07T22:47:50.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25712024-11-07T22:47:50.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25722024-11-07T22:47:50.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25732024-11-07T22:47:50.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 85.884248ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25742024-11-07T22:47:50.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 964, tv_nsec: 994570733 } })
25752024-11-07T22:47:50.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
25762024-11-07T22:47:50.906ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
25772024-11-07T22:47:50.906ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 87.731248ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
25782024-11-07T22:47:50.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25792024-11-07T22:47:50.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25802024-11-07T22:47:50.912ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25812024-11-07T22:47:50.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25822024-11-07T22:47:50.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25832024-11-07T22:47:50.914ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25842024-11-07T22:47:50.915ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25852024-11-07T22:47:50.915ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25862024-11-07T22:47:50.915ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25872024-11-07T22:47:50.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25882024-11-07T22:47:50.919ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25892024-11-07T22:47:50.919ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25902024-11-07T22:47:50.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
25912024-11-07T22:47:50.919ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25922024-11-07T22:47:50.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25932024-11-07T22:47:50.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25942024-11-07T22:47:50.921ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25952024-11-07T22:47:50.922ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 103.78288ms iteration = 11 status = 0
25962024-11-07T22:47:50.923ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25972024-11-07T22:47:50.923ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
25982024-11-07T22:47:50.923ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
25992024-11-07T22:47:50.923ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
26002024-11-07T22:47:50.923ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
26012024-11-07T22:47:50.923ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
26022024-11-07T22:47:50.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26032024-11-07T22:47:50.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26042024-11-07T22:47:50.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26052024-11-07T22:47:50.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26062024-11-07T22:47:50.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26072024-11-07T22:47:50.924ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26082024-11-07T22:47:50.924ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26092024-11-07T22:47:50.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26102024-11-07T22:47:50.928ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26112024-11-07T22:47:50.933ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26122024-11-07T22:47:50.933ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26132024-11-07T22:47:50.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26142024-11-07T22:47:50.933ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26152024-11-07T22:47:50.935ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26162024-11-07T22:47:50.936ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
26172024-11-07T22:47:50.936ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26182024-11-07T22:47:50.936ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
26192024-11-07T22:47:50.936ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
26202024-11-07T22:47:50.936ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-07 22:43:11.086261 UTC dns_group = internal generation = 1
26212024-11-07T22:47:50.936ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 117.814499ms iteration = 7 status = {"generation":1}
26222024-11-07T22:47:50.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26232024-11-07T22:47:50.940ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26242024-11-07T22:47:50.940ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26252024-11-07T22:47:50.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26262024-11-07T22:47:50.944ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 125.405853ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
26272024-11-07T22:47:50.944ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
26282024-11-07T22:47:50.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
26292024-11-07T22:47:50.951ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26302024-11-07T22:47:50.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26312024-11-07T22:47:50.952ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 133.375639ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
26322024-11-07T22:47:50.959ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26332024-11-07T22:47:50.959ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
26342024-11-07T22:47:50.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
26352024-11-07T22:47:50.964ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26362024-11-07T22:47:50.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26372024-11-07T22:47:50.968ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26382024-11-07T22:47:50.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26392024-11-07T22:47:50.971ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26402024-11-07T22:47:50.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26412024-11-07T22:47:50.974ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26422024-11-07T22:47:50.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26432024-11-07T22:47:50.985ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26442024-11-07T22:47:50.985ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
26452024-11-07T22:47:50.985ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 166.715139ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
26462024-11-07T22:47:50.989ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
26472024-11-07T22:47:50.989ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 0 version = 2
26482024-11-07T22:47:50.989ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26492024-11-07T22:47:50.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26502024-11-07T22:47:50.993ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
26512024-11-07T22:47:50.995ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-07T22:42:48.907310Z, time_modified: 2024-11-07T22:42:48.907310Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }) }
26522024-11-07T22:47:50.995ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 176.328168ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]}},"default_endpoint":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
26532024-11-07T22:47:51.066ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 247.321924ms iteration = 14 status = {"physical_disks_added":0}
26542024-11-07T22:47:51.071ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
26552024-11-07T22:47:51.071ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 252.71284ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
26562024-11-07T22:47:51.090ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
26572024-11-07T22:47:51.090ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26582024-11-07T22:47:51.090ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "08c6172a-7e88-458a-bb6a-78e6e9dfb17d", "content-length": "26", "date": "Thu, 07 Nov 2024 22:47:51 GMT"} })
26592024-11-07T22:47:51.090ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26602024-11-07T22:47:51.094ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26612024-11-07T22:47:51.108ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
26622024-11-07T22:47:51.108ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26632024-11-07T22:47:51.108ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdffcea3-158f-4981-ae25-6c3188d3a74d", "content-length": "26", "date": "Thu, 07 Nov 2024 22:47:51 GMT"} })
26642024-11-07T22:47:51.108ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26652024-11-07T22:47:51.116ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26662024-11-07T22:47:51.148ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26672024-11-07T22:47:51.149ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "55495cee-200f-4f85-9d19-7de0860ff1a5", "content-length": "691", "date": "Thu, 07 Nov 2024 22:47:51 GMT"} })
26682024-11-07T22:47:51.149ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
26692024-11-07T22:47:51.149ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
26702024-11-07T22:47:51.149ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
26712024-11-07T22:47:51.152ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 333.578502ms iteration = 11 status = {}
26722024-11-07T22:47:51.199ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26732024-11-07T22:47:51.199ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26742024-11-07T22:47:51.200ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "804bc009-e728-4d2e-a188-7cc7c0cb15a5", "content-length": "372", "date": "Thu, 07 Nov 2024 22:47:51 GMT"} })
26752024-11-07T22:47:51.200ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26762024-11-07T22:47:51.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26772024-11-07T22:47:51.202ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26782024-11-07T22:47:51.202ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26792024-11-07T22:47:51.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26802024-11-07T22:47:51.205ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26812024-11-07T22:47:51.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26822024-11-07T22:47:51.206ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26832024-11-07T22:47:51.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26842024-11-07T22:47:51.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26852024-11-07T22:47:51.206ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26862024-11-07T22:47:51.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26872024-11-07T22:47:51.208ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 1 version = 2
26882024-11-07T22:47:51.208ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
26892024-11-07T22:47:51.208ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-07 22:43:11.643428 UTC dns_group = external generation = 2
26902024-11-07T22:47:51.208ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 389.829149ms iteration = 7 status = {"generation":2}
26912024-11-07T22:47:51.210ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
26922024-11-07T22:47:51.210ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26932024-11-07T22:47:51.210ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7927d050-4915-4cc4-af90-238678928038", "content-length": "26", "date": "Thu, 07 Nov 2024 22:47:51 GMT"} })
26942024-11-07T22:47:51.210ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26952024-11-07T22:47:51.212ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
26962024-11-07T22:47:51.237ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
26972024-11-07T22:47:51.237ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "cedc4bbc-6b43-4f25-8d5f-72a427da1a0e", "date": "Thu, 07 Nov 2024 22:47:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26982024-11-07T22:47:51.237ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26992024-11-07T22:47:51.239ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6084f7e2-6b8d-471f-8ee1-50aad89ac7fd", "date": "Thu, 07 Nov 2024 22:47:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27002024-11-07T22:47:51.239ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27012024-11-07T22:47:51.240ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27022024-11-07T22:47:51.240ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 421.653018ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
27032024-11-07T22:47:51.245ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
27042024-11-07T22:47:51.245ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 426.690854ms iteration = 11 status = {}
27052024-11-07T22:47:51.249ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27062024-11-07T22:47:51.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
27072024-11-07T22:47:51.253ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27082024-11-07T22:47:51.253ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
27092024-11-07T22:47:51.253ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
27102024-11-07T22:47:51.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27112024-11-07T22:47:51.253ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "92c5721a-8844-424e-aac2-4d0c0a1eae6b", "date": "Thu, 07 Nov 2024 22:47:51 GMT"} })
27122024-11-07T22:47:51.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27132024-11-07T22:47:51.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27142024-11-07T22:47:51.255ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27152024-11-07T22:47:51.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27162024-11-07T22:47:51.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27172024-11-07T22:47:51.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27182024-11-07T22:47:51.257ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27192024-11-07T22:47:51.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27202024-11-07T22:47:51.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27212024-11-07T22:47:51.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27222024-11-07T22:47:51.260ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27232024-11-07T22:47:51.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27242024-11-07T22:47:51.261ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
27252024-11-07T22:47:51.261ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27262024-11-07T22:47:51.261ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9028e866-180d-415b-a4a7-bb30a28594b0", "date": "Thu, 07 Nov 2024 22:47:51 GMT"} })
27272024-11-07T22:47:51.262ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
27282024-11-07T22:47:51.262ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27292024-11-07T22:47:51.263ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 444.204287ms iteration = 12 status = {}
27302024-11-07T22:47:51.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27312024-11-07T22:47:51.263ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e537668c-a089-4f2d-a52d-1b029cdbe366", "content-length": "1", "date": "Thu, 07 Nov 2024 22:47:50 GMT"} })
27322024-11-07T22:47:51.264ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27332024-11-07T22:47:51.264ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27342024-11-07T22:47:51.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27352024-11-07T22:47:51.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27362024-11-07T22:47:51.266ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27372024-11-07T22:47:51.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27382024-11-07T22:47:51.266ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 448.012159ms iteration = 11 status = null
27392024-11-07T22:47:51.267ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27402024-11-07T22:47:51.271ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
27412024-11-07T22:47:51.271ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27422024-11-07T22:47:51.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27432024-11-07T22:47:51.272ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27442024-11-07T22:47:51.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27452024-11-07T22:47:51.274ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27462024-11-07T22:47:51.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27472024-11-07T22:47:51.275ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27482024-11-07T22:47:51.279ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
27492024-11-07T22:47:51.279ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27502024-11-07T22:47:51.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27512024-11-07T22:47:51.287ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27522024-11-07T22:47:51.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27532024-11-07T22:47:51.288ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27542024-11-07T22:47:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27552024-11-07T22:47:51.290ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27562024-11-07T22:47:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27572024-11-07T22:47:51.292ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
27582024-11-07T22:47:51.292ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "498c7281-ce78-48ab-a358-9327a9b23737", "date": "Thu, 07 Nov 2024 22:47:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
27592024-11-07T22:47:51.292ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
27602024-11-07T22:47:51.293ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27612024-11-07T22:47:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27622024-11-07T22:47:51.293ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5964bf10-0d7c-4d97-8e23-21d8d271cba3", "date": "Thu, 07 Nov 2024 22:47:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
27632024-11-07T22:47:51.293ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
27642024-11-07T22:47:51.295ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ca1a8618-83e3-4a27-8e6d-75b3d1848792", "date": "Thu, 07 Nov 2024 22:47:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
27652024-11-07T22:47:51.295ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
27662024-11-07T22:47:51.295ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27672024-11-07T22:47:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27682024-11-07T22:47:51.296ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
27692024-11-07T22:47:51.296ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 477.801254ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
27702024-11-07T22:47:51.297ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27712024-11-07T22:47:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27722024-11-07T22:47:51.298ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27732024-11-07T22:47:51.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27742024-11-07T22:47:51.299ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27752024-11-07T22:47:51.303ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
27762024-11-07T22:47:51.303ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27772024-11-07T22:47:51.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27782024-11-07T22:47:51.305ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27792024-11-07T22:47:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27802024-11-07T22:47:51.306ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27812024-11-07T22:47:51.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27822024-11-07T22:47:51.308ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27832024-11-07T22:47:51.311ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
27842024-11-07T22:47:51.311ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27852024-11-07T22:47:51.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27862024-11-07T22:47:51.319ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 45b10ace-97a4-4ae9-b37f-3abfe43591bc, kind: Service { id: 19da6a5b-073a-4e12-8775-91fc61c1e962 }, name: Name("external-dns-19da6a5b-073a-4e12-8775-91fc61c1e962"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 180])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7461ea38-345b-4151-b71f-10e7e61b2bc4, kind: Service { id: 939b4884-df0a-49e9-b0e5-27de78137ddd }, name: Name("external-dns-939b4884-df0a-49e9-b0e5-27de78137ddd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 151])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 2dd87331-1080-4a71-a905-3e46ecebaf6c, kind: Service { id: 377e4941-a34d-4c51-b725-3cc833f8df14 }, name: Name("nexus-377e4941-a34d-4c51-b725-3cc833f8df14"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 64ed67c2-1a18-431c-8723-5c0738c08c4e, kind: Service { id: a5da1467-f0f3-4c0d-ad94-ed83c65ca978 }, name: Name("nexus-a5da1467-f0f3-4c0d-ad94-ed83c65ca978"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 89])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8a3c0e3f-1bcc-4caf-a59c-866543a0723e, kind: Service { id: 42e8095c-4973-40db-9d13-0be7e130d89d }, name: Name("nexus-42e8095c-4973-40db-9d13-0be7e130d89d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
27872024-11-07T22:47:51.319ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27882024-11-07T22:47:51.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27892024-11-07T22:47:51.320ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27902024-11-07T22:47:51.322ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
27912024-11-07T22:47:51.322ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27922024-11-07T22:47:51.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27932024-11-07T22:47:51.324ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
27942024-11-07T22:47:51.324ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 45b10ace-97a4-4ae9-b37f-3abfe43591bc, kind: Service { id: 19da6a5b-073a-4e12-8775-91fc61c1e962 }, name: Name("external-dns-19da6a5b-073a-4e12-8775-91fc61c1e962"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 180])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7461ea38-345b-4151-b71f-10e7e61b2bc4, kind: Service { id: 939b4884-df0a-49e9-b0e5-27de78137ddd }, name: Name("external-dns-939b4884-df0a-49e9-b0e5-27de78137ddd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 151])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2dd87331-1080-4a71-a905-3e46ecebaf6c, kind: Service { id: 377e4941-a34d-4c51-b725-3cc833f8df14 }, name: Name("nexus-377e4941-a34d-4c51-b725-3cc833f8df14"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 64ed67c2-1a18-431c-8723-5c0738c08c4e, kind: Service { id: a5da1467-f0f3-4c0d-ad94-ed83c65ca978 }, name: Name("nexus-a5da1467-f0f3-4c0d-ad94-ed83c65ca978"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 89])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8a3c0e3f-1bcc-4caf-a59c-866543a0723e, kind: Service { id: 42e8095c-4973-40db-9d13-0be7e130d89d }, name: Name("nexus-42e8095c-4973-40db-9d13-0be7e130d89d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
27952024-11-07T22:47:51.324ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
27962024-11-07T22:47:51.353ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27972024-11-07T22:47:51.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27982024-11-07T22:47:51.355ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
27992024-11-07T22:47:51.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28002024-11-07T22:47:51.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28012024-11-07T22:47:51.364ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
28022024-11-07T22:47:51.364ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f6c718e-22ec-41bc-b9cf-f1cfab576437", "content-length": "134", "date": "Thu, 07 Nov 2024 22:47:50 GMT"} })
28032024-11-07T22:47:51.364ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
28042024-11-07T22:47:51.364ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
28052024-11-07T22:47:51.365ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
28062024-11-07T22:47:51.365ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
28072024-11-07T22:47:51.365ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28082024-11-07T22:47:51.365ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28092024-11-07T22:47:51.365ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28102024-11-07T22:47:51.365ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28112024-11-07T22:47:51.365ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28122024-11-07T22:47:51.365ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28132024-11-07T22:47:51.365ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
28142024-11-07T22:47:51.365ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28152024-11-07T22:47:51.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28162024-11-07T22:47:51.368ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
28172024-11-07T22:47:51.368ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d079fbd-3498-446c-8714-616b3c9679c8", "content-length": "2", "date": "Thu, 07 Nov 2024 22:47:50 GMT"} })
28182024-11-07T22:47:51.368ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
28192024-11-07T22:47:51.368ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff4bee39-6f92-4ec3-bacb-aab37e5e05fa", "content-length": "52", "date": "Thu, 07 Nov 2024 22:47:50 GMT"} })
28202024-11-07T22:47:51.368ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
28212024-11-07T22:47:51.368ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
28222024-11-07T22:47:51.383ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, time_created: 2024-11-07T22:43:07.889510Z, time_modified: 2024-11-07T22:43:07.889510Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
28232024-11-07T22:47:51.383ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
28242024-11-07T22:47:51.383ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28252024-11-07T22:47:51.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28262024-11-07T22:47:51.385ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28272024-11-07T22:47:51.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28282024-11-07T22:47:51.386ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28292024-11-07T22:47:51.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
28302024-11-07T22:47:51.423ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28312024-11-07T22:47:51.473ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c94a0f19-2dbe-47c7-8b1c-6c0b7a4980a9", "date": "Thu, 07 Nov 2024 22:47:51 GMT"} })
28322024-11-07T22:47:51.473ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
28332024-11-07T22:47:51.473ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
28342024-11-07T22:47:51.474ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7e52f69-32bc-4204-8910-d5caf5fe75aa", "content-length": "682", "date": "Thu, 07 Nov 2024 22:47:51 GMT"} })
28352024-11-07T22:47:51.474ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28362024-11-07T22:47:51.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28372024-11-07T22:47:51.477ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28382024-11-07T22:47:51.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28392024-11-07T22:47:51.480ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "a4211e01-d585-4916-a261-dc9a050a61ae", "date": "Thu, 07 Nov 2024 22:47:51 GMT"} })
28402024-11-07T22:47:51.481ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28412024-11-07T22:47:51.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28422024-11-07T22:47:51.482ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
28432024-11-07T22:47:51.482ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 663.504104ms
28442024-11-07T22:47:51.482ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 663.525624ms iteration = 2 status = {}
28452024-11-07T22:47:51.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28462024-11-07T22:47:51.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28472024-11-07T22:47:51.490ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 671.741326ms iteration = 11 status = {}
28482024-11-07T22:47:51.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 0eb412da-ad0d-47c0-b98b-c2239a8b43a1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
28492024-11-07T22:47:51.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 0eb412da-ad0d-47c0-b98b-c2239a8b43a1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
28502024-11-07T22:47:51.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3618 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 0eb412da-ad0d-47c0-b98b-c2239a8b43a1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
28512024-11-07T22:47:51.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f0c0143f-b15c-424b-8fcb-470f8f07d7f8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28522024-11-07T22:47:51.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f0c0143f-b15c-424b-8fcb-470f8f07d7f8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28532024-11-07T22:47:51.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f0c0143f-b15c-424b-8fcb-470f8f07d7f8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28542024-11-07T22:47:52.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 835e735c-086b-48ad-8d59-f43b53c2fab8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28552024-11-07T22:47:52.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 835e735c-086b-48ad-8d59-f43b53c2fab8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28562024-11-07T22:47:52.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 835e735c-086b-48ad-8d59-f43b53c2fab8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28572024-11-07T22:47:53.143ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:53971
28582024-11-07T22:47:53.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53971 req_id = 0e102a2e-ac62-4cad-89ae-bb330918aafb roles = RoleSet { roles: {} } uri = /metrics/producers
28592024-11-07T22:47:53.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53971 req_id = 0e102a2e-ac62-4cad-89ae-bb330918aafb resource = Database result = Ok(()) uri = /metrics/producers
28602024-11-07T22:47:53.177ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28612024-11-07T22:47:53.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33584 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53971 req_id = 0e102a2e-ac62-4cad-89ae-bb330918aafb response_code = 201 uri = /metrics/producers
28622024-11-07T22:47:53.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0d000793-2d69-4913-90a1-a8a0e3d752bf roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28632024-11-07T22:47:53.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0d000793-2d69-4913-90a1-a8a0e3d752bf resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28642024-11-07T22:47:53.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0d000793-2d69-4913-90a1-a8a0e3d752bf response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28652024-11-07T22:47:54.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bb33934a-80d8-4a33-94c8-8e98d00766fd roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28662024-11-07T22:47:54.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bb33934a-80d8-4a33-94c8-8e98d00766fd resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28672024-11-07T22:47:54.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bb33934a-80d8-4a33-94c8-8e98d00766fd response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28682024-11-07T22:47:55.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3f3f4e90-5499-44ec-90e2-1709984f173a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28692024-11-07T22:47:55.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3f3f4e90-5499-44ec-90e2-1709984f173a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28702024-11-07T22:47:55.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2694 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3f3f4e90-5499-44ec-90e2-1709984f173a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28712024-11-07T22:47:56.186ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:56201
28722024-11-07T22:47:56.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56201 req_id = a97c15c2-028c-4539-9dd6-2f8faef8d009 roles = RoleSet { roles: {} } uri = /metrics/producers
28732024-11-07T22:47:56.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56201 req_id = a97c15c2-028c-4539-9dd6-2f8faef8d009 resource = Database result = Ok(()) uri = /metrics/producers
28742024-11-07T22:47:56.227ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 9e471274-19dd-4f92-b383-47c4daa65273
28752024-11-07T22:47:56.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41241 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56201 req_id = a97c15c2-028c-4539-9dd6-2f8faef8d009 response_code = 201 uri = /metrics/producers
28762024-11-07T22:47:56.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ba1146c8-b8e7-4258-8f0a-558e53298845 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28772024-11-07T22:47:56.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ba1146c8-b8e7-4258-8f0a-558e53298845 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28782024-11-07T22:47:56.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2690 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ba1146c8-b8e7-4258-8f0a-558e53298845 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28792024-11-07T22:47:57.552ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:43088
28802024-11-07T22:47:57.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43088 req_id = 7469d0fe-24e2-4dfe-95e2-50b0651ec59e roles = RoleSet { roles: {} } uri = /metrics/producers
28812024-11-07T22:47:57.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43088 req_id = 7469d0fe-24e2-4dfe-95e2-50b0651ec59e resource = Database result = Ok(()) uri = /metrics/producers
28822024-11-07T22:47:57.590ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 815e7211-42cf-4415-8116-29d4376e1760
28832024-11-07T22:47:57.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37753 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43088 req_id = 7469d0fe-24e2-4dfe-95e2-50b0651ec59e response_code = 201 uri = /metrics/producers
28842024-11-07T22:47:57.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6cbdb0b8-574a-4ffa-aa03-2edba7721e35 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28852024-11-07T22:47:57.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6cbdb0b8-574a-4ffa-aa03-2edba7721e35 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28862024-11-07T22:47:57.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6cbdb0b8-574a-4ffa-aa03-2edba7721e35 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28872024-11-07T22:47:58.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b9f9dff6-3390-4717-8ed0-fee713e6b33a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28882024-11-07T22:47:58.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b9f9dff6-3390-4717-8ed0-fee713e6b33a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28892024-11-07T22:47:58.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b9f9dff6-3390-4717-8ed0-fee713e6b33a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28902024-11-07T22:47:59.908ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:43238
28912024-11-07T22:47:59.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43238 req_id = 85cf10e9-7922-487f-9052-0f1cb1ba21e6 roles = RoleSet { roles: {} } uri = /metrics/producers
28922024-11-07T22:47:59.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43238 req_id = 85cf10e9-7922-487f-9052-0f1cb1ba21e6 resource = Database result = Ok(()) uri = /metrics/producers
28932024-11-07T22:47:59.919ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 43a27374-6630-4b8d-a3e3-a2857df923bd
28942024-11-07T22:47:59.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10714 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43238 req_id = 85cf10e9-7922-487f-9052-0f1cb1ba21e6 response_code = 201 uri = /metrics/producers
28952024-11-07T22:47:59.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 19cd6466-ff09-452c-8122-660ae69ef0a3 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28962024-11-07T22:47:59.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 19cd6466-ff09-452c-8122-660ae69ef0a3 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28972024-11-07T22:47:59.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 19cd6466-ff09-452c-8122-660ae69ef0a3 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
28982024-11-07T22:48:00.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
28992024-11-07T22:48:00.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
29002024-11-07T22:48:00.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29012024-11-07T22:48:00.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29022024-11-07T22:48:00.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29032024-11-07T22:48:00.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29042024-11-07T22:48:00.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29052024-11-07T22:48:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29062024-11-07T22:48:00.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29072024-11-07T22:48:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29082024-11-07T22:48:00.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29092024-11-07T22:48:00.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29102024-11-07T22:48:00.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29112024-11-07T22:48:00.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
29122024-11-07T22:48:00.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29132024-11-07T22:48:00.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29142024-11-07T22:48:00.846ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
29152024-11-07T22:48:00.846ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.82514ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
29162024-11-07T22:48:00.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29172024-11-07T22:48:00.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29182024-11-07T22:48:00.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.595506ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29192024-11-07T22:48:00.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 34cc5be6-9f56-4086-91b1-bf5ffb4d4270 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29202024-11-07T22:48:00.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 34cc5be6-9f56-4086-91b1-bf5ffb4d4270 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29212024-11-07T22:48:00.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 34cc5be6-9f56-4086-91b1-bf5ffb4d4270 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29222024-11-07T22:48:01.654ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1896 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 4cbc31b4-69c8-48a4-a1a0-eaca4db96842 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
29232024-11-07T22:48:02.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e942f0d9-af17-4795-aa58-b8f2d6951d7f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29242024-11-07T22:48:02.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e942f0d9-af17-4795-aa58-b8f2d6951d7f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29252024-11-07T22:48:02.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2694 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e942f0d9-af17-4795-aa58-b8f2d6951d7f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29262024-11-07T22:48:03.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b40902b0-b552-459e-8505-512c7bbca6c7 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29272024-11-07T22:48:03.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b40902b0-b552-459e-8505-512c7bbca6c7 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29282024-11-07T22:48:03.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b40902b0-b552-459e-8505-512c7bbca6c7 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29292024-11-07T22:48:04.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e7fdbdb5-c7dc-4f9c-a4b0-a0ad8381db78 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29302024-11-07T22:48:04.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e7fdbdb5-c7dc-4f9c-a4b0-a0ad8381db78 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29312024-11-07T22:48:04.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e7fdbdb5-c7dc-4f9c-a4b0-a0ad8381db78 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29322024-11-07T22:48:05.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 72155271-ebad-4d0c-82c3-369443c4c438 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29332024-11-07T22:48:05.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 72155271-ebad-4d0c-82c3-369443c4c438 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29342024-11-07T22:48:05.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 72155271-ebad-4d0c-82c3-369443c4c438 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29352024-11-07T22:48:06.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 54c65a52-e3e6-4b3f-8b23-1a7d3ee970b6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29362024-11-07T22:48:06.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 54c65a52-e3e6-4b3f-8b23-1a7d3ee970b6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29372024-11-07T22:48:06.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2498 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 54c65a52-e3e6-4b3f-8b23-1a7d3ee970b6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29382024-11-07T22:48:06.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = f0ea703e-fcbb-4163-9b04-de64b7b8f159 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
29392024-11-07T22:48:06.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = f0ea703e-fcbb-4163-9b04-de64b7b8f159 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
29402024-11-07T22:48:06.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3741 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = f0ea703e-fcbb-4163-9b04-de64b7b8f159 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
29412024-11-07T22:48:06.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 1de196ae-4bea-4708-af8f-40a6fa0b6e2a roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
29422024-11-07T22:48:06.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 1de196ae-4bea-4708-af8f-40a6fa0b6e2a resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
29432024-11-07T22:48:06.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 1de196ae-4bea-4708-af8f-40a6fa0b6e2a response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
29442024-11-07T22:48:07.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 324a3411-37b9-472d-ba15-fd9694391323 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29452024-11-07T22:48:07.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 324a3411-37b9-472d-ba15-fd9694391323 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29462024-11-07T22:48:07.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 324a3411-37b9-472d-ba15-fd9694391323 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29472024-11-07T22:48:08.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f3d2a0d2-c274-4e61-ad67-a00cfabc15e1 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29482024-11-07T22:48:08.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f3d2a0d2-c274-4e61-ad67-a00cfabc15e1 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29492024-11-07T22:48:08.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f3d2a0d2-c274-4e61-ad67-a00cfabc15e1 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29502024-11-07T22:48:09.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f8f32091-ec3f-481b-8fc0-9c2b4bc9263d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29512024-11-07T22:48:09.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f8f32091-ec3f-481b-8fc0-9c2b4bc9263d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29522024-11-07T22:48:09.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2079 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f8f32091-ec3f-481b-8fc0-9c2b4bc9263d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29532024-11-07T22:48:10.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5d5d5323-8855-4f9b-906b-19ac1148fcb5 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29542024-11-07T22:48:10.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5d5d5323-8855-4f9b-906b-19ac1148fcb5 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29552024-11-07T22:48:10.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5d5d5323-8855-4f9b-906b-19ac1148fcb5 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29562024-11-07T22:48:10.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
29572024-11-07T22:48:10.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
29582024-11-07T22:48:10.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29592024-11-07T22:48:10.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29602024-11-07T22:48:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29612024-11-07T22:48:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29622024-11-07T22:48:10.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29632024-11-07T22:48:10.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29642024-11-07T22:48:10.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29652024-11-07T22:48:10.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29662024-11-07T22:48:10.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29672024-11-07T22:48:10.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29682024-11-07T22:48:10.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29692024-11-07T22:48:10.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
29702024-11-07T22:48:10.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29712024-11-07T22:48:10.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29722024-11-07T22:48:10.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
29732024-11-07T22:48:10.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.680339ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
29742024-11-07T22:48:10.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29752024-11-07T22:48:10.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29762024-11-07T22:48:10.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.467788ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29772024-11-07T22:48:11.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2b990d53-b53d-4c85-bbeb-d39c40090f2d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29782024-11-07T22:48:11.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2b990d53-b53d-4c85-bbeb-d39c40090f2d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29792024-11-07T22:48:11.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2b990d53-b53d-4c85-bbeb-d39c40090f2d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29802024-11-07T22:48:12.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ccc1caad-987c-44ee-b018-696a4db878c5 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29812024-11-07T22:48:12.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ccc1caad-987c-44ee-b018-696a4db878c5 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29822024-11-07T22:48:12.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1659 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ccc1caad-987c-44ee-b018-696a4db878c5 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29832024-11-07T22:48:12.692ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
29842024-11-07T22:48:12.692ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
29852024-11-07T22:48:12.722ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
29862024-11-07T22:48:12.722ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:59591
29872024-11-07T22:48:12.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:59591 req_id = b26255e0-843e-4023-9d97-4b3de703bb14 roles = RoleSet { roles: {} } uri = /metrics/producers
29882024-11-07T22:48:12.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:59591 req_id = b26255e0-843e-4023-9d97-4b3de703bb14 resource = Database result = Ok(()) uri = /metrics/producers
29892024-11-07T22:48:12.763ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 377e4941-a34d-4c51-b725-3cc833f8df14
29902024-11-07T22:48:12.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40303 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:59591 req_id = b26255e0-843e-4023-9d97-4b3de703bb14 response_code = 201 uri = /metrics/producers
29912024-11-07T22:48:12.763ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "b26255e0-843e-4023-9d97-4b3de703bb14", "content-length": "41", "date": "Thu, 07 Nov 2024 22:48:12 GMT"} })
29922024-11-07T22:48:12.765ZDEBGnexus (producer-registration-task): registered with nexus successfully
29932024-11-07T22:48:12.765ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
29942024-11-07T22:48:13.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 241b37b9-c9e8-4f9f-b1b7-5482482f6402 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29952024-11-07T22:48:13.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 241b37b9-c9e8-4f9f-b1b7-5482482f6402 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29962024-11-07T22:48:13.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 241b37b9-c9e8-4f9f-b1b7-5482482f6402 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29972024-11-07T22:48:14.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b39d335e-e966-43cc-90ca-167aa2109be8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29982024-11-07T22:48:14.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b39d335e-e966-43cc-90ca-167aa2109be8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
29992024-11-07T22:48:14.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b39d335e-e966-43cc-90ca-167aa2109be8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30002024-11-07T22:48:15.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2ec76f30-eebc-498f-a950-03dabb5f3793 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30012024-11-07T22:48:15.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2ec76f30-eebc-498f-a950-03dabb5f3793 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30022024-11-07T22:48:15.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2ec76f30-eebc-498f-a950-03dabb5f3793 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30032024-11-07T22:48:16.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 915e3507-1581-4a39-8252-6a454a7e179a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30042024-11-07T22:48:16.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 915e3507-1581-4a39-8252-6a454a7e179a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30052024-11-07T22:48:16.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1607 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 915e3507-1581-4a39-8252-6a454a7e179a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30062024-11-07T22:48:16.655ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1624 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 176e8c13-9eb4-497f-97ae-67fe38f858f0 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
30072024-11-07T22:48:17.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dc958fb4-b639-4cd4-a3ee-137cd5cbdcd2 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30082024-11-07T22:48:17.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dc958fb4-b639-4cd4-a3ee-137cd5cbdcd2 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30092024-11-07T22:48:17.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2546 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dc958fb4-b639-4cd4-a3ee-137cd5cbdcd2 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30102024-11-07T22:48:18.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 48455d68-c4d9-4b01-8e51-d1cec3d30594 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30112024-11-07T22:48:18.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 48455d68-c4d9-4b01-8e51-d1cec3d30594 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30122024-11-07T22:48:18.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 48455d68-c4d9-4b01-8e51-d1cec3d30594 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30132024-11-07T22:48:19.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 962a57c4-7cd9-415c-8d2d-4fc6065bb682 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30142024-11-07T22:48:19.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 962a57c4-7cd9-415c-8d2d-4fc6065bb682 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30152024-11-07T22:48:19.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2506 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 962a57c4-7cd9-415c-8d2d-4fc6065bb682 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30162024-11-07T22:48:20.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 78ee6427-abcd-4b43-bbe4-51e40b31b5a2 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30172024-11-07T22:48:20.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 78ee6427-abcd-4b43-bbe4-51e40b31b5a2 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30182024-11-07T22:48:20.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 78ee6427-abcd-4b43-bbe4-51e40b31b5a2 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
30192024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
30202024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
30212024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30222024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
30232024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30242024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
30252024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
30262024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30272024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
30282024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
30292024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30302024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30312024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
30322024-11-07T22:48:20.819ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
30332024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30342024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
30352024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
30362024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
30372024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
30382024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
30392024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30402024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
30412024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30422024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
30432024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30442024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30452024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30462024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
30472024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30482024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
30492024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
30502024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30512024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30522024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
30532024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30542024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30552024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
30562024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30572024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30582024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30592024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30602024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30612024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30622024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30632024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30642024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30652024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30662024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
30672024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30682024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30692024-11-07T22:48:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30702024-11-07T22:48:20.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30712024-11-07T22:48:20.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30722024-11-07T22:48:20.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30732024-11-07T22:48:20.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30742024-11-07T22:48:20.822ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.425392ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
30752024-11-07T22:48:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30762024-11-07T22:48:20.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30772024-11-07T22:48:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30782024-11-07T22:48:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
30792024-11-07T22:48:20.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30802024-11-07T22:48:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30812024-11-07T22:48:20.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30822024-11-07T22:48:20.826ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 994, tv_nsec: 916135406 } })
30832024-11-07T22:48:20.827ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30842024-11-07T22:48:20.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30852024-11-07T22:48:20.827ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
30862024-11-07T22:48:20.827ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30872024-11-07T22:48:20.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30882024-11-07T22:48:20.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
30892024-11-07T22:48:20.829ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30902024-11-07T22:48:20.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30912024-11-07T22:48:20.830ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 994, tv_nsec: 919564439 } })
30922024-11-07T22:48:20.830ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
30932024-11-07T22:48:20.831ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30942024-11-07T22:48:20.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.020881ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30952024-11-07T22:48:20.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
30962024-11-07T22:48:20.835ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30972024-11-07T22:48:20.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30982024-11-07T22:48:20.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30992024-11-07T22:48:20.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31002024-11-07T22:48:20.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31012024-11-07T22:48:20.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31022024-11-07T22:48:20.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31032024-11-07T22:48:20.840ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 994, tv_nsec: 929537288 } })
31042024-11-07T22:48:20.840ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
31052024-11-07T22:48:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
31062024-11-07T22:48:20.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31072024-11-07T22:48:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31082024-11-07T22:48:20.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 31.940812ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
31092024-11-07T22:48:20.860ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31102024-11-07T22:48:20.860ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
31112024-11-07T22:48:20.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31122024-11-07T22:48:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31132024-11-07T22:48:20.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.307959ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
31142024-11-07T22:48:20.866ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
31152024-11-07T22:48:20.866ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.170133ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
31162024-11-07T22:48:20.867ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31172024-11-07T22:48:20.867ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31182024-11-07T22:48:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31192024-11-07T22:48:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31202024-11-07T22:48:20.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31212024-11-07T22:48:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31222024-11-07T22:48:20.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31232024-11-07T22:48:20.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31242024-11-07T22:48:20.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31252024-11-07T22:48:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31262024-11-07T22:48:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31272024-11-07T22:48:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31282024-11-07T22:48:20.876ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31292024-11-07T22:48:20.877ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31302024-11-07T22:48:20.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31312024-11-07T22:48:20.878ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31322024-11-07T22:48:20.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31332024-11-07T22:48:20.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31342024-11-07T22:48:20.879ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31352024-11-07T22:48:20.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31362024-11-07T22:48:20.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31372024-11-07T22:48:20.881ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 62.456985ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
31382024-11-07T22:48:20.882ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31392024-11-07T22:48:20.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31402024-11-07T22:48:20.883ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 64.668235ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
31412024-11-07T22:48:20.884ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
31422024-11-07T22:48:20.884ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.84167ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
31432024-11-07T22:48:20.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
31442024-11-07T22:48:20.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31452024-11-07T22:48:20.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31462024-11-07T22:48:20.887ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 67.963574ms iteration = 12 status = 0
31472024-11-07T22:48:20.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31482024-11-07T22:48:20.892ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31492024-11-07T22:48:20.892ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31502024-11-07T22:48:20.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31512024-11-07T22:48:20.914ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31522024-11-07T22:48:20.914ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31532024-11-07T22:48:20.914ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31542024-11-07T22:48:20.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31552024-11-07T22:48:20.922ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 102.991339ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
31562024-11-07T22:48:20.955ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
31572024-11-07T22:48:20.955ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31582024-11-07T22:48:20.956ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce744546-fc14-44fb-9c0e-7235475c8216", "content-length": "26", "date": "Thu, 07 Nov 2024 22:48:20 GMT"} })
31592024-11-07T22:48:20.956ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31602024-11-07T22:48:20.957ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
31612024-11-07T22:48:20.961ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31622024-11-07T22:48:20.961ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
31632024-11-07T22:48:20.961ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 141.802277ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
31642024-11-07T22:48:20.975ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31652024-11-07T22:48:20.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31662024-11-07T22:48:21.009ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 190.057649ms iteration = 15 status = {"physical_disks_added":0}
31672024-11-07T22:48:21.013ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
31682024-11-07T22:48:21.013ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31692024-11-07T22:48:21.014ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7f2f65b-e005-4527-b025-f2084ce00cce", "content-length": "26", "date": "Thu, 07 Nov 2024 22:48:20 GMT"} })
31702024-11-07T22:48:21.014ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31712024-11-07T22:48:21.015ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31722024-11-07T22:48:21.024ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31732024-11-07T22:48:21.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31742024-11-07T22:48:21.026ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31752024-11-07T22:48:21.028ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31762024-11-07T22:48:21.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31772024-11-07T22:48:21.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31782024-11-07T22:48:21.029ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
31792024-11-07T22:48:21.029ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31802024-11-07T22:48:21.029ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e3fb5b1-da2f-455c-91b0-5a99ab688de4", "content-length": "26", "date": "Thu, 07 Nov 2024 22:48:20 GMT"} })
31812024-11-07T22:48:21.029ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31822024-11-07T22:48:21.031ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31832024-11-07T22:48:21.113ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
31842024-11-07T22:48:21.113ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31852024-11-07T22:48:21.114ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecb35d5d-b355-4995-94f1-74109c9e9016", "content-length": "372", "date": "Thu, 07 Nov 2024 22:48:21 GMT"} })
31862024-11-07T22:48:21.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31872024-11-07T22:48:21.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31882024-11-07T22:48:21.121ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 302.01135ms iteration = 12 status = {}
31892024-11-07T22:48:21.131ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
31902024-11-07T22:48:21.131ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "df7f4505-cbae-4602-bf89-f9b82cf14182", "content-length": "1", "date": "Thu, 07 Nov 2024 22:48:20 GMT"} })
31912024-11-07T22:48:21.132ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31922024-11-07T22:48:21.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31932024-11-07T22:48:21.134ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 315.39445ms iteration = 12 status = null
31942024-11-07T22:48:21.145ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31952024-11-07T22:48:21.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31962024-11-07T22:48:21.147ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31972024-11-07T22:48:21.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31982024-11-07T22:48:21.167ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
31992024-11-07T22:48:21.167ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
32002024-11-07T22:48:21.197ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32012024-11-07T22:48:21.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32022024-11-07T22:48:21.198ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
32032024-11-07T22:48:21.198ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32042024-11-07T22:48:21.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32052024-11-07T22:48:21.206ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32062024-11-07T22:48:21.206ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
32072024-11-07T22:48:21.207ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0dcd47e7-dc72-4191-aacf-25d7fc61287f", "content-length": "134", "date": "Thu, 07 Nov 2024 22:48:20 GMT"} })
32082024-11-07T22:48:21.207ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
32092024-11-07T22:48:21.207ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
32102024-11-07T22:48:21.207ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
32112024-11-07T22:48:21.207ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32122024-11-07T22:48:21.207ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32132024-11-07T22:48:21.207ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32142024-11-07T22:48:21.207ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32152024-11-07T22:48:21.207ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32162024-11-07T22:48:21.207ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32172024-11-07T22:48:21.207ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32182024-11-07T22:48:21.208ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
32192024-11-07T22:48:21.208ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32202024-11-07T22:48:21.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32212024-11-07T22:48:21.210ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32222024-11-07T22:48:21.210ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "864755b2-c205-4737-a84d-176fcaa154ae", "content-length": "2", "date": "Thu, 07 Nov 2024 22:48:20 GMT"} })
32232024-11-07T22:48:21.210ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
32242024-11-07T22:48:21.210ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9542d17d-04b1-45d6-84d2-7e793eeca206", "content-length": "52", "date": "Thu, 07 Nov 2024 22:48:20 GMT"} })
32252024-11-07T22:48:21.210ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
32262024-11-07T22:48:21.210ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32272024-11-07T22:48:21.269ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "eecbcfbb-e93c-4ac4-b9e0-edca9d11d3cf", "date": "Thu, 07 Nov 2024 22:48:21 GMT"} })
32282024-11-07T22:48:21.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32292024-11-07T22:48:21.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32302024-11-07T22:48:21.270ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d610fbe-a6f3-40fa-931d-5a427db592bc", "content-length": "691", "date": "Thu, 07 Nov 2024 22:48:21 GMT"} })
32312024-11-07T22:48:21.270ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
32322024-11-07T22:48:21.270ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
32332024-11-07T22:48:21.270ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
32342024-11-07T22:48:21.271ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 452.501581ms iteration = 12 status = {}
32352024-11-07T22:48:21.272ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32362024-11-07T22:48:21.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32372024-11-07T22:48:21.277ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32382024-11-07T22:48:21.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32392024-11-07T22:48:21.279ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
32402024-11-07T22:48:21.279ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32412024-11-07T22:48:21.280ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bc431c01-0b9a-47c2-aecc-f5a66e4f034d", "date": "Thu, 07 Nov 2024 22:48:21 GMT"} })
32422024-11-07T22:48:21.282ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 462.925112ms iteration = 13 status = {}
32432024-11-07T22:48:21.371ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "623e0612-2ad3-4139-82ca-e254e4c3e8b9", "date": "Thu, 07 Nov 2024 22:48:21 GMT"} })
32442024-11-07T22:48:21.371ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
32452024-11-07T22:48:21.371ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32462024-11-07T22:48:21.374ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a299284-e69d-472b-9e4c-1df4cb397c94", "content-length": "682", "date": "Thu, 07 Nov 2024 22:48:21 GMT"} })
32472024-11-07T22:48:21.374ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32482024-11-07T22:48:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32492024-11-07T22:48:21.378ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32502024-11-07T22:48:21.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32512024-11-07T22:48:21.382ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32522024-11-07T22:48:21.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32532024-11-07T22:48:21.383ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32542024-11-07T22:48:21.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32552024-11-07T22:48:21.391ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 572.320843ms iteration = 12 status = {}
32562024-11-07T22:48:21.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 91aa5b0a-1038-451a-b144-dafb242eb73f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32572024-11-07T22:48:21.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 91aa5b0a-1038-451a-b144-dafb242eb73f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32582024-11-07T22:48:21.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1794 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 91aa5b0a-1038-451a-b144-dafb242eb73f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32592024-11-07T22:48:21.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 9a1269bf-ef67-461e-bc69-ec5016a77332 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
32602024-11-07T22:48:21.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 9a1269bf-ef67-461e-bc69-ec5016a77332 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
32612024-11-07T22:48:21.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2730 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 9a1269bf-ef67-461e-bc69-ec5016a77332 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
32622024-11-07T22:48:22.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bb645b9d-84e9-4569-943a-b32c7fbd442d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32632024-11-07T22:48:22.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bb645b9d-84e9-4569-943a-b32c7fbd442d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32642024-11-07T22:48:22.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bb645b9d-84e9-4569-943a-b32c7fbd442d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32652024-11-07T22:48:23.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c46f90e2-615e-4de6-b8b8-495c31b6884c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32662024-11-07T22:48:23.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c46f90e2-615e-4de6-b8b8-495c31b6884c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32672024-11-07T22:48:23.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1591 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c46f90e2-615e-4de6-b8b8-495c31b6884c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32682024-11-07T22:48:24.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a1d3ffe6-26bb-4955-b2ef-3112cea451a1 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32692024-11-07T22:48:24.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a1d3ffe6-26bb-4955-b2ef-3112cea451a1 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32702024-11-07T22:48:24.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a1d3ffe6-26bb-4955-b2ef-3112cea451a1 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32712024-11-07T22:48:25.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7d545379-eab9-4ef4-9617-dbb6a15976a0 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32722024-11-07T22:48:25.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7d545379-eab9-4ef4-9617-dbb6a15976a0 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32732024-11-07T22:48:25.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7d545379-eab9-4ef4-9617-dbb6a15976a0 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32742024-11-07T22:48:26.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e2e1bf91-7b71-4316-b418-c1e6d15207cc roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32752024-11-07T22:48:26.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e2e1bf91-7b71-4316-b418-c1e6d15207cc resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32762024-11-07T22:48:26.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e2e1bf91-7b71-4316-b418-c1e6d15207cc response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32772024-11-07T22:48:27.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 16ca1037-c0ff-414f-a6ed-a3600d27799e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32782024-11-07T22:48:27.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 16ca1037-c0ff-414f-a6ed-a3600d27799e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32792024-11-07T22:48:27.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 16ca1037-c0ff-414f-a6ed-a3600d27799e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32802024-11-07T22:48:28.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fcfd499c-5b48-4789-9d85-22b1c33e3877 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32812024-11-07T22:48:28.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fcfd499c-5b48-4789-9d85-22b1c33e3877 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32822024-11-07T22:48:28.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fcfd499c-5b48-4789-9d85-22b1c33e3877 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32832024-11-07T22:48:29.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8846a12f-2bcf-4568-9777-e814648f4b59 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32842024-11-07T22:48:29.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8846a12f-2bcf-4568-9777-e814648f4b59 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32852024-11-07T22:48:29.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8846a12f-2bcf-4568-9777-e814648f4b59 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32862024-11-07T22:48:30.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8d438873-9e89-4366-8ab9-a08290588e34 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32872024-11-07T22:48:30.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8d438873-9e89-4366-8ab9-a08290588e34 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32882024-11-07T22:48:30.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8d438873-9e89-4366-8ab9-a08290588e34 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
32892024-11-07T22:48:30.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
32902024-11-07T22:48:30.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
32912024-11-07T22:48:30.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32922024-11-07T22:48:30.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32932024-11-07T22:48:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32942024-11-07T22:48:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32952024-11-07T22:48:30.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32962024-11-07T22:48:30.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32972024-11-07T22:48:30.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32982024-11-07T22:48:30.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.150345ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32992024-11-07T22:48:30.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33002024-11-07T22:48:30.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33012024-11-07T22:48:30.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33022024-11-07T22:48:30.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33032024-11-07T22:48:30.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33042024-11-07T22:48:30.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33052024-11-07T22:48:30.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
33062024-11-07T22:48:30.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33072024-11-07T22:48:30.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33082024-11-07T22:48:30.840ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
33092024-11-07T22:48:30.840ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.772117ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
33102024-11-07T22:48:31.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 52eae363-01f4-470d-b872-521a55988cea roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33112024-11-07T22:48:31.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 52eae363-01f4-470d-b872-521a55988cea resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33122024-11-07T22:48:31.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 52eae363-01f4-470d-b872-521a55988cea response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33132024-11-07T22:48:31.653ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1409 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 9643b280-50f5-4180-872d-2f82cd57c0e3 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
33142024-11-07T22:48:32.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 47c20b9c-401b-4510-8e1c-b780898c8b27 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33152024-11-07T22:48:32.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 47c20b9c-401b-4510-8e1c-b780898c8b27 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33162024-11-07T22:48:32.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1605 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 47c20b9c-401b-4510-8e1c-b780898c8b27 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33172024-11-07T22:48:33.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 89d20ffa-2444-4a62-9951-e2d5891928e2 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33182024-11-07T22:48:33.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 89d20ffa-2444-4a62-9951-e2d5891928e2 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33192024-11-07T22:48:33.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 89d20ffa-2444-4a62-9951-e2d5891928e2 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33202024-11-07T22:48:34.147ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:56796
33212024-11-07T22:48:34.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56796 req_id = 5d235c16-7be5-4b2b-be28-cf8f474473d5 roles = RoleSet { roles: {} } uri = /metrics/producers
33222024-11-07T22:48:34.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56796 req_id = 5d235c16-7be5-4b2b-be28-cf8f474473d5 resource = Database result = Ok(()) uri = /metrics/producers
33232024-11-07T22:48:34.186ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = e777764e-54ab-4a09-9e71-5c47b8b59e5e
33242024-11-07T22:48:34.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38715 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56796 req_id = 5d235c16-7be5-4b2b-be28-cf8f474473d5 response_code = 201 uri = /metrics/producers
33252024-11-07T22:48:34.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f489b946-ad2a-43b7-a619-44b6a031288a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33262024-11-07T22:48:34.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f489b946-ad2a-43b7-a619-44b6a031288a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33272024-11-07T22:48:34.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1806 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f489b946-ad2a-43b7-a619-44b6a031288a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33282024-11-07T22:48:35.610ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:50495
33292024-11-07T22:48:35.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50495 req_id = bfd94fa7-6c8a-4638-9476-8181e60673b8 roles = RoleSet { roles: {} } uri = /metrics/producers
33302024-11-07T22:48:35.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50495 req_id = bfd94fa7-6c8a-4638-9476-8181e60673b8 resource = Database result = Ok(()) uri = /metrics/producers
33312024-11-07T22:48:35.622ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 5fb8d961-b437-4fc7-94a2-b09d338a9d9d
33322024-11-07T22:48:35.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11044 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50495 req_id = bfd94fa7-6c8a-4638-9476-8181e60673b8 response_code = 201 uri = /metrics/producers
33332024-11-07T22:48:35.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 79ca0d18-6b10-4342-99b2-f6200e59267e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33342024-11-07T22:48:35.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 79ca0d18-6b10-4342-99b2-f6200e59267e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33352024-11-07T22:48:35.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 79ca0d18-6b10-4342-99b2-f6200e59267e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33362024-11-07T22:48:36.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9932e515-62ef-467a-adb6-e3bd462b13b3 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33372024-11-07T22:48:36.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9932e515-62ef-467a-adb6-e3bd462b13b3 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33382024-11-07T22:48:36.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2809 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9932e515-62ef-467a-adb6-e3bd462b13b3 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33392024-11-07T22:48:37.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cf32c09f-62b0-468d-a7a5-d947d60763d5 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33402024-11-07T22:48:37.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cf32c09f-62b0-468d-a7a5-d947d60763d5 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33412024-11-07T22:48:37.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2322 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cf32c09f-62b0-468d-a7a5-d947d60763d5 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33422024-11-07T22:48:38.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 119225c6-7385-47c8-9c2b-bc460113f4f9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33432024-11-07T22:48:38.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 119225c6-7385-47c8-9c2b-bc460113f4f9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33442024-11-07T22:48:38.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 119225c6-7385-47c8-9c2b-bc460113f4f9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33452024-11-07T22:48:39.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8a32c39c-23fd-4407-a650-dc6e8f869e2d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33462024-11-07T22:48:39.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8a32c39c-23fd-4407-a650-dc6e8f869e2d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33472024-11-07T22:48:39.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8a32c39c-23fd-4407-a650-dc6e8f869e2d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33482024-11-07T22:48:40.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
33492024-11-07T22:48:40.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
33502024-11-07T22:48:40.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33512024-11-07T22:48:40.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33522024-11-07T22:48:40.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33532024-11-07T22:48:40.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33542024-11-07T22:48:40.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33552024-11-07T22:48:40.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33562024-11-07T22:48:40.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33572024-11-07T22:48:40.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33582024-11-07T22:48:40.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33592024-11-07T22:48:40.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33602024-11-07T22:48:40.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.362095ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33612024-11-07T22:48:40.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33622024-11-07T22:48:40.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33632024-11-07T22:48:40.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33642024-11-07T22:48:40.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
33652024-11-07T22:48:40.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33662024-11-07T22:48:40.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33672024-11-07T22:48:40.840ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
33682024-11-07T22:48:40.840ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.21904ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
33692024-11-07T22:48:40.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d115c90a-6b5a-4d09-90f1-dea7c0dfa4cb roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33702024-11-07T22:48:40.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d115c90a-6b5a-4d09-90f1-dea7c0dfa4cb resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33712024-11-07T22:48:40.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1859 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d115c90a-6b5a-4d09-90f1-dea7c0dfa4cb response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33722024-11-07T22:48:41.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4ff56cce-35bc-44cd-b2fe-b582c3fd79ea roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33732024-11-07T22:48:41.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4ff56cce-35bc-44cd-b2fe-b582c3fd79ea resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33742024-11-07T22:48:41.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4ff56cce-35bc-44cd-b2fe-b582c3fd79ea response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33752024-11-07T22:48:42.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bb53779c-bda7-44ad-81c6-19fe9906e5bd roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33762024-11-07T22:48:42.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bb53779c-bda7-44ad-81c6-19fe9906e5bd resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33772024-11-07T22:48:42.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bb53779c-bda7-44ad-81c6-19fe9906e5bd response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33782024-11-07T22:48:43.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 15b9b1c7-2815-4b8f-b01a-bd4810cbbded roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33792024-11-07T22:48:43.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 15b9b1c7-2815-4b8f-b01a-bd4810cbbded resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33802024-11-07T22:48:43.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 15b9b1c7-2815-4b8f-b01a-bd4810cbbded response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33812024-11-07T22:48:44.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cac123a8-ce12-47b6-a1fd-d573f684ddb0 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33822024-11-07T22:48:44.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cac123a8-ce12-47b6-a1fd-d573f684ddb0 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33832024-11-07T22:48:44.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1786 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cac123a8-ce12-47b6-a1fd-d573f684ddb0 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33842024-11-07T22:48:45.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8939ae78-8084-483d-969b-dcd327a96ddf roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33852024-11-07T22:48:45.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8939ae78-8084-483d-969b-dcd327a96ddf resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33862024-11-07T22:48:45.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8939ae78-8084-483d-969b-dcd327a96ddf response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33872024-11-07T22:48:46.656ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1752 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 74d62ef2-9064-4902-a96f-8d3cc9fca7b8 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
33882024-11-07T22:48:46.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 48e3a29b-8352-45bd-a390-a80f565f0195 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33892024-11-07T22:48:46.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 48e3a29b-8352-45bd-a390-a80f565f0195 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33902024-11-07T22:48:46.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 48e3a29b-8352-45bd-a390-a80f565f0195 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33912024-11-07T22:48:48.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4275bed6-7860-47b4-93e4-79c237804cc9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33922024-11-07T22:48:48.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4275bed6-7860-47b4-93e4-79c237804cc9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33932024-11-07T22:48:48.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4275bed6-7860-47b4-93e4-79c237804cc9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33942024-11-07T22:48:49.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9106eb1f-7a57-4705-b767-a667ea0b0226 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33952024-11-07T22:48:49.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9106eb1f-7a57-4705-b767-a667ea0b0226 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33962024-11-07T22:48:49.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9106eb1f-7a57-4705-b767-a667ea0b0226 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33972024-11-07T22:48:50.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1d940e50-14e7-4a6f-b909-3f3e5e4d5f7d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33982024-11-07T22:48:50.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1d940e50-14e7-4a6f-b909-3f3e5e4d5f7d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
33992024-11-07T22:48:50.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1786 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1d940e50-14e7-4a6f-b909-3f3e5e4d5f7d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
34002024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
34012024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
34022024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34032024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
34042024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
34052024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
34062024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34072024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
34082024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
34092024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
34102024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34112024-11-07T22:48:50.819ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-07 22:38:50.819223954 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
34122024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
34132024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
34142024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
34152024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
34162024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
34172024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
34182024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
34192024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
34202024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
34212024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
34222024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34232024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
34242024-11-07T22:48:50.819ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531
34252024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
34262024-11-07T22:48:50.819ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
34272024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.421\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531"}
34282024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
34292024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
34302024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34312024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34322024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
34332024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
34342024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
34352024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
34362024-11-07T22:48:50.819ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
34372024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34382024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
34392024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34402024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
34412024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
34422024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
34432024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
34442024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34452024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34462024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
34472024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
34482024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34492024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
34502024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34512024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34522024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
34532024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
34542024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34552024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
34562024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34572024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
34582024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34592024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
34602024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34612024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
34622024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
34632024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34642024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34652024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34662024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34672024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
34682024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
34692024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34702024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34712024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
34722024-11-07T22:48:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
34732024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
34742024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
34752024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34762024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34772024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34782024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34792024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34802024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34812024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34822024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34832024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34842024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34852024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34862024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34872024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34882024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34892024-11-07T22:48:50.820ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19da6a5b-073a-4e12-8775-91fc61c1e962.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1024, tv_nsec: 909351233 } })
34902024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34912024-11-07T22:48:50.820ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a127151b-10b2-4835-91ce-b493ecd30481.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("de9282a1-0aa7-4ad8-a39a-58f19d05b651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1024, tv_nsec: 909358153 } })
34922024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34932024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34942024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34952024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34962024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34972024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
34982024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34992024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.174212ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
35002024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35012024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
35022024-11-07T22:48:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.343196ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
35032024-11-07T22:48:50.821ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35042024-11-07T22:48:50.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35052024-11-07T22:48:50.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35062024-11-07T22:48:50.822ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1024, tv_nsec: 911548363 } })
35072024-11-07T22:48:50.822ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.160015ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35082024-11-07T22:48:50.822ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
35092024-11-07T22:48:50.823ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-07 22:38:50.819223954 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
35102024-11-07T22:48:50.823ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.955217ms iteration = 7 status = {"expiration":"2024-11-07T22:38:50.819223954Z","pruned":[]}
35112024-11-07T22:48:50.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35122024-11-07T22:48:50.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35132024-11-07T22:48:50.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35142024-11-07T22:48:50.827ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.939424ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
35152024-11-07T22:48:50.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.291244ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
35162024-11-07T22:48:50.827ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35172024-11-07T22:48:50.829ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35182024-11-07T22:48:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
35192024-11-07T22:48:50.830ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
35202024-11-07T22:48:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
35212024-11-07T22:48:50.833ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35222024-11-07T22:48:50.833ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35232024-11-07T22:48:50.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35242024-11-07T22:48:50.837ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35252024-11-07T22:48:50.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35262024-11-07T22:48:50.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35272024-11-07T22:48:50.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35282024-11-07T22:48:50.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35292024-11-07T22:48:50.840ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1024, tv_nsec: 929222289 } })
35302024-11-07T22:48:50.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35312024-11-07T22:48:50.840ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
35322024-11-07T22:48:50.841ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35332024-11-07T22:48:50.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35342024-11-07T22:48:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35352024-11-07T22:48:50.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35362024-11-07T22:48:50.846ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35372024-11-07T22:48:50.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35382024-11-07T22:48:50.847ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35392024-11-07T22:48:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35402024-11-07T22:48:50.849ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35412024-11-07T22:48:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35422024-11-07T22:48:50.849ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35432024-11-07T22:48:50.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35442024-11-07T22:48:50.852ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35452024-11-07T22:48:50.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35462024-11-07T22:48:50.852ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35472024-11-07T22:48:50.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35482024-11-07T22:48:50.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
35492024-11-07T22:48:50.854ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35502024-11-07T22:48:50.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35512024-11-07T22:48:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35522024-11-07T22:48:50.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35532024-11-07T22:48:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35542024-11-07T22:48:50.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35552024-11-07T22:48:50.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 42.289931ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35562024-11-07T22:48:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35572024-11-07T22:48:50.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 44.623474ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
35582024-11-07T22:48:50.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35592024-11-07T22:48:50.873ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35602024-11-07T22:48:50.873ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35612024-11-07T22:48:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35622024-11-07T22:48:50.874ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35632024-11-07T22:48:50.874ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
35642024-11-07T22:48:50.874ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
35652024-11-07T22:48:50.874ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 55.331583ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
35662024-11-07T22:48:50.878ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35672024-11-07T22:48:50.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35682024-11-07T22:48:50.878ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35692024-11-07T22:48:50.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35702024-11-07T22:48:50.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35712024-11-07T22:48:50.881ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35722024-11-07T22:48:50.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35732024-11-07T22:48:50.882ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35742024-11-07T22:48:50.884ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35752024-11-07T22:48:50.884ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35762024-11-07T22:48:50.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35772024-11-07T22:48:50.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35782024-11-07T22:48:50.885ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1024, tv_nsec: 974539772 } })
35792024-11-07T22:48:50.885ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
35802024-11-07T22:48:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
35812024-11-07T22:48:50.886ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35822024-11-07T22:48:50.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35832024-11-07T22:48:50.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35842024-11-07T22:48:50.888ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35852024-11-07T22:48:50.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35862024-11-07T22:48:50.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35872024-11-07T22:48:50.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35882024-11-07T22:48:50.889ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35892024-11-07T22:48:50.889ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
35902024-11-07T22:48:50.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35912024-11-07T22:48:50.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35922024-11-07T22:48:50.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
35932024-11-07T22:48:50.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35942024-11-07T22:48:50.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35952024-11-07T22:48:50.894ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35962024-11-07T22:48:50.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35972024-11-07T22:48:50.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
35982024-11-07T22:48:50.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35992024-11-07T22:48:50.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
36002024-11-07T22:48:50.899ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36012024-11-07T22:48:50.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36022024-11-07T22:48:50.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36032024-11-07T22:48:50.912ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36042024-11-07T22:48:50.914ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
36052024-11-07T22:48:50.914ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
36062024-11-07T22:48:50.914ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
36072024-11-07T22:48:50.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36082024-11-07T22:48:50.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36092024-11-07T22:48:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36102024-11-07T22:48:50.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
36112024-11-07T22:48:50.915ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36122024-11-07T22:48:50.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36132024-11-07T22:48:50.917ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
36142024-11-07T22:48:50.917ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
36152024-11-07T22:48:50.917ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 98.230201ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
36162024-11-07T22:48:50.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36172024-11-07T22:48:50.926ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 106.698469ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36182024-11-07T22:48:50.937ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36192024-11-07T22:48:50.937ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 117.614904ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36202024-11-07T22:48:50.939ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36212024-11-07T22:48:50.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36222024-11-07T22:48:50.941ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
36232024-11-07T22:48:50.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
36242024-11-07T22:48:50.961ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
36252024-11-07T22:48:50.961ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
36262024-11-07T22:48:50.961ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
36272024-11-07T22:48:50.961ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36282024-11-07T22:48:50.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36292024-11-07T22:48:50.984ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
36302024-11-07T22:48:50.984ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36312024-11-07T22:48:50.984ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c836f70-50ca-47e1-8fed-ee1f603ca978", "content-length": "26", "date": "Thu, 07 Nov 2024 22:48:50 GMT"} })
36322024-11-07T22:48:50.984ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36332024-11-07T22:48:50.987ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36342024-11-07T22:48:51.002ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
36352024-11-07T22:48:51.006ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
36362024-11-07T22:48:51.066ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
36372024-11-07T22:48:51.066ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36382024-11-07T22:48:51.067ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "597d4f18-7d30-42e9-b69c-bf45b26f6819", "content-length": "26", "date": "Thu, 07 Nov 2024 22:48:50 GMT"} })
36392024-11-07T22:48:51.067ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36402024-11-07T22:48:51.069ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
36412024-11-07T22:48:51.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8424c38f-6176-4ef9-81eb-9f29eff4b6c1 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
36422024-11-07T22:48:51.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8424c38f-6176-4ef9-81eb-9f29eff4b6c1 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
36432024-11-07T22:48:51.095ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
36442024-11-07T22:48:51.095ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36452024-11-07T22:48:51.095ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "938568c1-fd00-4cee-8799-6bb98537623f", "content-length": "372", "date": "Thu, 07 Nov 2024 22:48:51 GMT"} })
36462024-11-07T22:48:51.095ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36472024-11-07T22:48:51.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36482024-11-07T22:48:51.098ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 278.856225ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
36492024-11-07T22:48:51.099ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36502024-11-07T22:48:51.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36512024-11-07T22:48:51.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36522024-11-07T22:48:51.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36532024-11-07T22:48:51.102ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 283.095219ms iteration = 4 status = {"nsuccess":5}
36542024-11-07T22:48:51.103ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36552024-11-07T22:48:51.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 29721 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8424c38f-6176-4ef9-81eb-9f29eff4b6c1 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
36562024-11-07T22:48:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36572024-11-07T22:48:51.107ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36582024-11-07T22:48:51.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36592024-11-07T22:48:51.110ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
36602024-11-07T22:48:51.110ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
36612024-11-07T22:48:51.110ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36622024-11-07T22:48:51.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36632024-11-07T22:48:51.111ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
36642024-11-07T22:48:51.111ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 292.716548ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
36652024-11-07T22:48:51.112ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36662024-11-07T22:48:51.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36672024-11-07T22:48:51.116ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36682024-11-07T22:48:51.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36692024-11-07T22:48:51.122ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
36702024-11-07T22:48:51.122ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
36712024-11-07T22:48:51.122ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-07 22:43:11.086261 UTC dns_group = internal generation = 1
36722024-11-07T22:48:51.122ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 302.915464ms iteration = 8 status = {"generation":1}
36732024-11-07T22:48:51.136ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36742024-11-07T22:48:51.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36752024-11-07T22:48:51.138ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36762024-11-07T22:48:51.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36772024-11-07T22:48:51.138ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 319.549723ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
36782024-11-07T22:48:51.138ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36792024-11-07T22:48:51.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36802024-11-07T22:48:51.140ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36812024-11-07T22:48:51.141ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36822024-11-07T22:48:51.143ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 324.004043ms iteration = 13 status = {}
36832024-11-07T22:48:51.143ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
36842024-11-07T22:48:51.143ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36852024-11-07T22:48:51.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36862024-11-07T22:48:51.144ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36872024-11-07T22:48:51.144ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36882024-11-07T22:48:51.144ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36892024-11-07T22:48:51.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36902024-11-07T22:48:51.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
36912024-11-07T22:48:51.145ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36922024-11-07T22:48:51.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36932024-11-07T22:48:51.146ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36942024-11-07T22:48:51.147ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36952024-11-07T22:48:51.149ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 330.207221ms iteration = 13 status = 0
36962024-11-07T22:48:51.149ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36972024-11-07T22:48:51.149ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36982024-11-07T22:48:51.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36992024-11-07T22:48:51.150ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
37002024-11-07T22:48:51.150ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37012024-11-07T22:48:51.151ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
37022024-11-07T22:48:51.151ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37032024-11-07T22:48:51.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37042024-11-07T22:48:51.151ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f0e3c5d-7380-4989-a2de-0c646e97aaf2", "content-length": "26", "date": "Thu, 07 Nov 2024 22:48:50 GMT"} })
37052024-11-07T22:48:51.151ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37062024-11-07T22:48:51.152ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37072024-11-07T22:48:51.168ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
37082024-11-07T22:48:51.168ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37092024-11-07T22:48:51.169ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0e068ef4-6df4-414f-8d11-ce38fed194fa", "date": "Thu, 07 Nov 2024 22:48:51 GMT"} })
37102024-11-07T22:48:51.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37112024-11-07T22:48:51.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37122024-11-07T22:48:51.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37132024-11-07T22:48:51.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37142024-11-07T22:48:51.175ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37152024-11-07T22:48:51.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37162024-11-07T22:48:51.178ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37172024-11-07T22:48:51.178ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37182024-11-07T22:48:51.179ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d167d14b-dd75-40ed-a724-b818f4d2da5f", "date": "Thu, 07 Nov 2024 22:48:51 GMT"} })
37192024-11-07T22:48:51.179ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37202024-11-07T22:48:51.179ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37212024-11-07T22:48:51.179ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 360.21523ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37222024-11-07T22:48:51.180ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 361.356871ms iteration = 14 status = {}
37232024-11-07T22:48:51.183ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
37242024-11-07T22:48:51.183ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "98c35688-2d76-449d-9062-378ad8cda5d9", "date": "Thu, 07 Nov 2024 22:48:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37252024-11-07T22:48:51.183ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37262024-11-07T22:48:51.185ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "dbea9f67-3cae-4014-bc4e-69e3dc585f10", "date": "Thu, 07 Nov 2024 22:48:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37272024-11-07T22:48:51.185ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37282024-11-07T22:48:51.186ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
37292024-11-07T22:48:51.186ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 367.236919ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
37302024-11-07T22:48:51.190ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-07T22:42:48.907310Z, time_modified: 2024-11-07T22:42:48.907310Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }) }
37312024-11-07T22:48:51.190ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 371.186136ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]}},"default_endpoint":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
37322024-11-07T22:48:51.194ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
37332024-11-07T22:48:51.194ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 0 version = 2
37342024-11-07T22:48:51.194ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37352024-11-07T22:48:51.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37362024-11-07T22:48:51.196ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37372024-11-07T22:48:51.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
37382024-11-07T22:48:51.200ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37392024-11-07T22:48:51.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37402024-11-07T22:48:51.202ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 1 version = 2
37412024-11-07T22:48:51.203ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
37422024-11-07T22:48:51.203ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-07 22:43:11.643428 UTC dns_group = external generation = 2
37432024-11-07T22:48:51.203ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 383.793526ms iteration = 8 status = {"generation":2}
37442024-11-07T22:48:51.211ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
37452024-11-07T22:48:51.211ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 391.868994ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
37462024-11-07T22:48:51.231ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37472024-11-07T22:48:51.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37482024-11-07T22:48:51.233ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
37492024-11-07T22:48:51.235ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37502024-11-07T22:48:51.238ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37512024-11-07T22:48:51.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37522024-11-07T22:48:51.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37532024-11-07T22:48:51.250ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37542024-11-07T22:48:51.253ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37552024-11-07T22:48:51.253ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37562024-11-07T22:48:51.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37572024-11-07T22:48:51.287ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 468.481082ms iteration = 16 status = {"physical_disks_added":0}
37582024-11-07T22:48:51.348ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
37592024-11-07T22:48:51.349ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7615f6ca-f4e1-4cda-8eed-e23766fb65cd", "content-length": "1", "date": "Thu, 07 Nov 2024 22:48:51 GMT"} })
37602024-11-07T22:48:51.351ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37612024-11-07T22:48:51.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37622024-11-07T22:48:51.354ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 534.657357ms iteration = 13 status = null
37632024-11-07T22:48:51.375ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
37642024-11-07T22:48:51.375ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ef8d821e-1dcc-418d-bc29-702c0aa6782f", "date": "Thu, 07 Nov 2024 22:48:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37652024-11-07T22:48:51.375ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37662024-11-07T22:48:51.377ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6ad97bb6-2b2d-4542-9ed3-e1f048016c44", "date": "Thu, 07 Nov 2024 22:48:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37672024-11-07T22:48:51.377ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37682024-11-07T22:48:51.379ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4cf1d7a9-3d56-44fc-ab14-7d7e642cff47", "date": "Thu, 07 Nov 2024 22:48:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37692024-11-07T22:48:51.379ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37702024-11-07T22:48:51.382ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37712024-11-07T22:48:51.382ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 562.883659ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
37722024-11-07T22:48:51.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37732024-11-07T22:48:51.402ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37742024-11-07T22:48:51.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37752024-11-07T22:48:51.403ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "821edd88-32f2-4cc4-9c66-1a21bc038572", "content-length": "691", "date": "Thu, 07 Nov 2024 22:48:51 GMT"} })
37762024-11-07T22:48:51.403ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
37772024-11-07T22:48:51.403ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
37782024-11-07T22:48:51.403ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
37792024-11-07T22:48:51.404ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 585.449837ms iteration = 13 status = {}
37802024-11-07T22:48:51.405ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
37812024-11-07T22:48:51.405ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37822024-11-07T22:48:51.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37832024-11-07T22:48:51.415ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37842024-11-07T22:48:51.415ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1c499f4-29ae-4669-9a6f-2d32dbb84115", "content-length": "134", "date": "Thu, 07 Nov 2024 22:48:51 GMT"} })
37852024-11-07T22:48:51.415ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37862024-11-07T22:48:51.415ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
37872024-11-07T22:48:51.416ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37882024-11-07T22:48:51.416ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37892024-11-07T22:48:51.416ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37902024-11-07T22:48:51.416ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37912024-11-07T22:48:51.416ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37922024-11-07T22:48:51.416ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37932024-11-07T22:48:51.416ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37942024-11-07T22:48:51.416ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37952024-11-07T22:48:51.416ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
37962024-11-07T22:48:51.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37972024-11-07T22:48:51.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37982024-11-07T22:48:51.418ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37992024-11-07T22:48:51.418ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d45d4d4b-dcbb-4efe-8a14-58396b35039c", "content-length": "2", "date": "Thu, 07 Nov 2024 22:48:51 GMT"} })
38002024-11-07T22:48:51.419ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38012024-11-07T22:48:51.419ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f56d681-f87a-42b3-87c2-9224ee819bb7", "content-length": "52", "date": "Thu, 07 Nov 2024 22:48:51 GMT"} })
38022024-11-07T22:48:51.419ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
38032024-11-07T22:48:51.419ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38042024-11-07T22:48:51.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 6077479c-7758-4538-a015-2a087a1de847 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
38052024-11-07T22:48:51.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 6077479c-7758-4538-a015-2a087a1de847 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
38062024-11-07T22:48:51.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 6077479c-7758-4538-a015-2a087a1de847 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
38072024-11-07T22:48:51.714ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8e7cf36e-cd64-4043-a0bd-c6a79cdfe8dc", "date": "Thu, 07 Nov 2024 22:48:51 GMT"} })
38082024-11-07T22:48:51.714ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
38092024-11-07T22:48:51.714ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38102024-11-07T22:48:51.715ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6571698f-11ce-4488-9239-069d0ef5d57f", "content-length": "682", "date": "Thu, 07 Nov 2024 22:48:51 GMT"} })
38112024-11-07T22:48:51.715ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38122024-11-07T22:48:51.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38132024-11-07T22:48:51.719ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38142024-11-07T22:48:51.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38152024-11-07T22:48:51.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38162024-11-07T22:48:51.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38172024-11-07T22:48:51.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38182024-11-07T22:48:51.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38192024-11-07T22:48:51.732ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 913.413707ms iteration = 13 status = {}
38202024-11-07T22:48:52.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dc2e8aa8-4c5e-4997-91b9-2e5f3f5c2665 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38212024-11-07T22:48:52.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dc2e8aa8-4c5e-4997-91b9-2e5f3f5c2665 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38222024-11-07T22:48:52.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dc2e8aa8-4c5e-4997-91b9-2e5f3f5c2665 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38232024-11-07T22:48:53.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7205890c-29d2-4f71-a46e-d96a9196b419 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38242024-11-07T22:48:53.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7205890c-29d2-4f71-a46e-d96a9196b419 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38252024-11-07T22:48:53.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7205890c-29d2-4f71-a46e-d96a9196b419 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38262024-11-07T22:48:54.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3e703637-f7ba-4b0d-b4cc-555b0f4b5483 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38272024-11-07T22:48:54.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3e703637-f7ba-4b0d-b4cc-555b0f4b5483 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38282024-11-07T22:48:54.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4742 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3e703637-f7ba-4b0d-b4cc-555b0f4b5483 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38292024-11-07T22:48:55.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3eb6a5cf-ec2e-494f-902a-114928c37067 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38302024-11-07T22:48:55.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3eb6a5cf-ec2e-494f-902a-114928c37067 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38312024-11-07T22:48:55.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3eb6a5cf-ec2e-494f-902a-114928c37067 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38322024-11-07T22:48:56.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6034a1d8-e0e0-4f2d-a4ea-dd716ec8f112 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38332024-11-07T22:48:56.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6034a1d8-e0e0-4f2d-a4ea-dd716ec8f112 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38342024-11-07T22:48:56.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2986 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6034a1d8-e0e0-4f2d-a4ea-dd716ec8f112 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38352024-11-07T22:48:57.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 42fb33a2-7498-471d-a5d8-eea76a12341e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38362024-11-07T22:48:57.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 42fb33a2-7498-471d-a5d8-eea76a12341e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38372024-11-07T22:48:57.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2504 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 42fb33a2-7498-471d-a5d8-eea76a12341e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38382024-11-07T22:48:58.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9df3b879-3449-4cf7-be45-e85f73955432 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38392024-11-07T22:48:58.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9df3b879-3449-4cf7-be45-e85f73955432 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38402024-11-07T22:48:58.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9df3b879-3449-4cf7-be45-e85f73955432 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38412024-11-07T22:48:59.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 96a33ab9-52f0-4dcd-a8d8-a5bbc3056a65 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38422024-11-07T22:48:59.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 96a33ab9-52f0-4dcd-a8d8-a5bbc3056a65 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38432024-11-07T22:48:59.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 96a33ab9-52f0-4dcd-a8d8-a5bbc3056a65 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38442024-11-07T22:49:00.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bce0dfa9-194c-4c19-8248-9eefa9b40a03 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38452024-11-07T22:49:00.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bce0dfa9-194c-4c19-8248-9eefa9b40a03 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38462024-11-07T22:49:00.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2522 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bce0dfa9-194c-4c19-8248-9eefa9b40a03 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38472024-11-07T22:49:00.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
38482024-11-07T22:49:00.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38492024-11-07T22:49:00.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
38502024-11-07T22:49:00.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38512024-11-07T22:49:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38522024-11-07T22:49:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38532024-11-07T22:49:00.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38542024-11-07T22:49:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38552024-11-07T22:49:00.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38562024-11-07T22:49:00.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38572024-11-07T22:49:00.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38582024-11-07T22:49:00.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38592024-11-07T22:49:00.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38602024-11-07T22:49:00.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
38612024-11-07T22:49:00.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38622024-11-07T22:49:00.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38632024-11-07T22:49:00.841ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
38642024-11-07T22:49:00.841ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.809556ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
38652024-11-07T22:49:00.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38662024-11-07T22:49:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38672024-11-07T22:49:00.884ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.722354ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38682024-11-07T22:49:01.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 34407616-5413-48bb-8d21-4600598322ae roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38692024-11-07T22:49:01.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 34407616-5413-48bb-8d21-4600598322ae resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38702024-11-07T22:49:01.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 34407616-5413-48bb-8d21-4600598322ae response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38712024-11-07T22:49:01.653ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1389 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = fe9210e2-2a49-441b-ad7c-0ea9d9640f27 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
38722024-11-07T22:49:02.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ccd75b04-aece-4405-a583-4f88ef979f70 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38732024-11-07T22:49:02.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ccd75b04-aece-4405-a583-4f88ef979f70 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38742024-11-07T22:49:02.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2334 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ccd75b04-aece-4405-a583-4f88ef979f70 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38752024-11-07T22:49:03.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 833827c6-8340-41ab-baad-2e07ae165070 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38762024-11-07T22:49:03.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 833827c6-8340-41ab-baad-2e07ae165070 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38772024-11-07T22:49:03.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1533 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 833827c6-8340-41ab-baad-2e07ae165070 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38782024-11-07T22:49:04.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4d6eeff8-56f9-4de7-a1f4-7f8629479011 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38792024-11-07T22:49:04.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4d6eeff8-56f9-4de7-a1f4-7f8629479011 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38802024-11-07T22:49:04.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4d6eeff8-56f9-4de7-a1f4-7f8629479011 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38812024-11-07T22:49:05.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bf718448-aedc-41d8-976e-87b3390b4b1c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38822024-11-07T22:49:05.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bf718448-aedc-41d8-976e-87b3390b4b1c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38832024-11-07T22:49:05.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bf718448-aedc-41d8-976e-87b3390b4b1c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38842024-11-07T22:49:06.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 52b65353-dfc0-4c1e-9e54-324b33755d55 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38852024-11-07T22:49:06.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 52b65353-dfc0-4c1e-9e54-324b33755d55 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38862024-11-07T22:49:06.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 52b65353-dfc0-4c1e-9e54-324b33755d55 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38872024-11-07T22:49:07.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d4b12d34-7517-492f-b2c1-13f26401b97d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38882024-11-07T22:49:07.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d4b12d34-7517-492f-b2c1-13f26401b97d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38892024-11-07T22:49:07.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2007 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d4b12d34-7517-492f-b2c1-13f26401b97d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38902024-11-07T22:49:08.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 75d2bb3b-80f5-4aad-b72f-5ac0ed2374f3 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38912024-11-07T22:49:08.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 75d2bb3b-80f5-4aad-b72f-5ac0ed2374f3 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38922024-11-07T22:49:08.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1643 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 75d2bb3b-80f5-4aad-b72f-5ac0ed2374f3 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38932024-11-07T22:49:09.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e4c47836-d709-485e-a647-532593978c92 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38942024-11-07T22:49:09.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e4c47836-d709-485e-a647-532593978c92 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38952024-11-07T22:49:09.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2051 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e4c47836-d709-485e-a647-532593978c92 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38962024-11-07T22:49:10.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ed0c4eff-cdd3-4d8e-ba70-f1282b80401a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38972024-11-07T22:49:10.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ed0c4eff-cdd3-4d8e-ba70-f1282b80401a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38982024-11-07T22:49:10.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2496 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ed0c4eff-cdd3-4d8e-ba70-f1282b80401a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
38992024-11-07T22:49:10.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
39002024-11-07T22:49:10.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
39012024-11-07T22:49:10.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39022024-11-07T22:49:10.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39032024-11-07T22:49:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39042024-11-07T22:49:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39052024-11-07T22:49:10.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39062024-11-07T22:49:10.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39072024-11-07T22:49:10.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39082024-11-07T22:49:10.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39092024-11-07T22:49:10.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39102024-11-07T22:49:10.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39112024-11-07T22:49:10.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39122024-11-07T22:49:10.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
39132024-11-07T22:49:10.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39142024-11-07T22:49:10.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39152024-11-07T22:49:10.841ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
39162024-11-07T22:49:10.841ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.768634ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
39172024-11-07T22:49:10.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39182024-11-07T22:49:10.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39192024-11-07T22:49:10.880ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.899101ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39202024-11-07T22:49:11.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6da56f37-6da5-4350-ab69-6820c55ce438 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39212024-11-07T22:49:11.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6da56f37-6da5-4350-ab69-6820c55ce438 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39222024-11-07T22:49:11.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2755 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6da56f37-6da5-4350-ab69-6820c55ce438 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39232024-11-07T22:49:12.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 539f469a-b3b7-4466-be0f-9ea2f9055651 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39242024-11-07T22:49:12.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 539f469a-b3b7-4466-be0f-9ea2f9055651 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39252024-11-07T22:49:12.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1758 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 539f469a-b3b7-4466-be0f-9ea2f9055651 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39262024-11-07T22:49:13.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a1692b05-4f4e-42dc-9862-bc5ca3dbeee6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39272024-11-07T22:49:13.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a1692b05-4f4e-42dc-9862-bc5ca3dbeee6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39282024-11-07T22:49:13.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a1692b05-4f4e-42dc-9862-bc5ca3dbeee6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39292024-11-07T22:49:14.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0c9f6d1d-b76b-482a-9fe3-349207d7c0e0 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39302024-11-07T22:49:14.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0c9f6d1d-b76b-482a-9fe3-349207d7c0e0 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39312024-11-07T22:49:14.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1889 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0c9f6d1d-b76b-482a-9fe3-349207d7c0e0 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39322024-11-07T22:49:15.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 00dcf041-9d38-4b5e-bf1c-768e946b99af roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39332024-11-07T22:49:15.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 00dcf041-9d38-4b5e-bf1c-768e946b99af resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39342024-11-07T22:49:15.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 00dcf041-9d38-4b5e-bf1c-768e946b99af response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39352024-11-07T22:49:16.653ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1285 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 9da3cdba-dedd-4717-909f-5a7fcc5d8509 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
39362024-11-07T22:49:16.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 393d3614-730b-42c2-a219-361c211ef4cb roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39372024-11-07T22:49:16.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 393d3614-730b-42c2-a219-361c211ef4cb resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39382024-11-07T22:49:16.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2689 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 393d3614-730b-42c2-a219-361c211ef4cb response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39392024-11-07T22:49:17.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0b4e5979-1013-439f-b4a1-9de255c98962 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39402024-11-07T22:49:17.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0b4e5979-1013-439f-b4a1-9de255c98962 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39412024-11-07T22:49:17.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0b4e5979-1013-439f-b4a1-9de255c98962 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39422024-11-07T22:49:18.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 59083dbe-0668-4315-b0de-3301ddc30b26 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39432024-11-07T22:49:18.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 59083dbe-0668-4315-b0de-3301ddc30b26 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39442024-11-07T22:49:18.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2538 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 59083dbe-0668-4315-b0de-3301ddc30b26 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39452024-11-07T22:49:19.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 558e978d-17dc-46f7-b072-8bdc14fb3c29 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39462024-11-07T22:49:19.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 558e978d-17dc-46f7-b072-8bdc14fb3c29 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39472024-11-07T22:49:19.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 558e978d-17dc-46f7-b072-8bdc14fb3c29 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39482024-11-07T22:49:20.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1df8d028-83b6-4f6e-bf9b-9febbf3160d1 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39492024-11-07T22:49:20.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1df8d028-83b6-4f6e-bf9b-9febbf3160d1 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39502024-11-07T22:49:20.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1df8d028-83b6-4f6e-bf9b-9febbf3160d1 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
39512024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
39522024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
39532024-11-07T22:49:20.818ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39542024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39552024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
39562024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39572024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
39582024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39592024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39602024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
39612024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39622024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
39632024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39642024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
39652024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
39662024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39672024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
39682024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39692024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39702024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
39712024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39722024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
39732024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39742024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39752024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
39762024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
39772024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39782024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
39792024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
39802024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39812024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39822024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
39832024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39842024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
39852024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39862024-11-07T22:49:20.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39872024-11-07T22:49:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39882024-11-07T22:49:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39892024-11-07T22:49:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39902024-11-07T22:49:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39912024-11-07T22:49:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39922024-11-07T22:49:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39932024-11-07T22:49:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39942024-11-07T22:49:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39952024-11-07T22:49:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39962024-11-07T22:49:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39972024-11-07T22:49:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39982024-11-07T22:49:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39992024-11-07T22:49:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40002024-11-07T22:49:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40012024-11-07T22:49:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40022024-11-07T22:49:20.820ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40032024-11-07T22:49:20.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40042024-11-07T22:49:20.821ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1054, tv_nsec: 910908955 } })
40052024-11-07T22:49:20.822ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
40062024-11-07T22:49:20.822ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1054, tv_nsec: 911682176 } })
40072024-11-07T22:49:20.822ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
40082024-11-07T22:49:20.822ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.056319ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
40092024-11-07T22:49:20.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40102024-11-07T22:49:20.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40112024-11-07T22:49:20.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40122024-11-07T22:49:20.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40132024-11-07T22:49:20.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40142024-11-07T22:49:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40152024-11-07T22:49:20.825ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40162024-11-07T22:49:20.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40172024-11-07T22:49:20.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40182024-11-07T22:49:20.828ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40192024-11-07T22:49:20.828ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40202024-11-07T22:49:20.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40212024-11-07T22:49:20.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40222024-11-07T22:49:20.829ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40232024-11-07T22:49:20.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40242024-11-07T22:49:20.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40252024-11-07T22:49:20.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40262024-11-07T22:49:20.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40272024-11-07T22:49:20.834ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40282024-11-07T22:49:20.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40292024-11-07T22:49:20.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40302024-11-07T22:49:20.834ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1054, tv_nsec: 924111962 } })
40312024-11-07T22:49:20.835ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40322024-11-07T22:49:20.835ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40332024-11-07T22:49:20.835ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
40342024-11-07T22:49:20.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40352024-11-07T22:49:20.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40362024-11-07T22:49:20.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40372024-11-07T22:49:20.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40382024-11-07T22:49:20.836ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40392024-11-07T22:49:20.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40402024-11-07T22:49:20.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40412024-11-07T22:49:20.869ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40422024-11-07T22:49:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40432024-11-07T22:49:20.873ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40442024-11-07T22:49:20.873ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40452024-11-07T22:49:20.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40462024-11-07T22:49:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40472024-11-07T22:49:20.875ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40482024-11-07T22:49:20.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40492024-11-07T22:49:20.877ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40502024-11-07T22:49:20.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40512024-11-07T22:49:20.879ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.209745ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
40522024-11-07T22:49:20.880ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40532024-11-07T22:49:20.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40542024-11-07T22:49:20.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.463793ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
40552024-11-07T22:49:20.882ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40562024-11-07T22:49:20.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40572024-11-07T22:49:20.885ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40582024-11-07T22:49:20.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40592024-11-07T22:49:20.891ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40602024-11-07T22:49:20.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40612024-11-07T22:49:20.893ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40622024-11-07T22:49:20.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40632024-11-07T22:49:20.894ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40642024-11-07T22:49:20.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40652024-11-07T22:49:20.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40662024-11-07T22:49:20.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
40672024-11-07T22:49:20.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40682024-11-07T22:49:20.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40692024-11-07T22:49:20.926ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
40702024-11-07T22:49:20.926ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40712024-11-07T22:49:20.927ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "edc971ec-b43e-4823-b4b8-56008103ccc1", "content-length": "26", "date": "Thu, 07 Nov 2024 22:49:20 GMT"} })
40722024-11-07T22:49:20.927ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40732024-11-07T22:49:20.929ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40742024-11-07T22:49:20.949ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
40752024-11-07T22:49:20.949ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40762024-11-07T22:49:20.949ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fba34e57-ce67-4c1c-b8c3-16101ba485d0", "content-length": "26", "date": "Thu, 07 Nov 2024 22:49:20 GMT"} })
40772024-11-07T22:49:20.949ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40782024-11-07T22:49:20.951ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
40792024-11-07T22:49:20.999ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40802024-11-07T22:49:21.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40812024-11-07T22:49:21.044ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
40822024-11-07T22:49:21.044ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40832024-11-07T22:49:21.044ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5807c10-1e94-494a-b617-9d5e06832c72", "content-length": "26", "date": "Thu, 07 Nov 2024 22:49:20 GMT"} })
40842024-11-07T22:49:21.044ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40852024-11-07T22:49:21.046ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40862024-11-07T22:49:21.048ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40872024-11-07T22:49:21.048ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40882024-11-07T22:49:21.048ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b435134-9459-4ad8-bf56-2522052ec535", "content-length": "372", "date": "Thu, 07 Nov 2024 22:49:21 GMT"} })
40892024-11-07T22:49:21.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40902024-11-07T22:49:21.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40912024-11-07T22:49:21.051ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40922024-11-07T22:49:21.051ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40932024-11-07T22:49:21.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40942024-11-07T22:49:21.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40952024-11-07T22:49:21.052ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40962024-11-07T22:49:21.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40972024-11-07T22:49:21.067ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40982024-11-07T22:49:21.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
40992024-11-07T22:49:21.070ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41002024-11-07T22:49:21.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41012024-11-07T22:49:21.073ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 254.841647ms iteration = 14 status = 0
41022024-11-07T22:49:21.079ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
41032024-11-07T22:49:21.079ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 261.314672ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
41042024-11-07T22:49:21.089ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
41052024-11-07T22:49:21.089ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 270.285024ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
41062024-11-07T22:49:21.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41072024-11-07T22:49:21.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41082024-11-07T22:49:21.095ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 276.851311ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41092024-11-07T22:49:21.096ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 277.323243ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41102024-11-07T22:49:21.099ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 280.811728ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
41112024-11-07T22:49:21.108ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41122024-11-07T22:49:21.109ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41132024-11-07T22:49:21.109ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41142024-11-07T22:49:21.109ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 290.649732ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
41152024-11-07T22:49:21.111ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41162024-11-07T22:49:21.111ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41172024-11-07T22:49:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41182024-11-07T22:49:21.113ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41192024-11-07T22:49:21.116ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41202024-11-07T22:49:21.116ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41212024-11-07T22:49:21.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41222024-11-07T22:49:21.120ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
41232024-11-07T22:49:21.120ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41242024-11-07T22:49:21.120ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "304512d4-e790-4734-aea3-96e4cecb81b2", "date": "Thu, 07 Nov 2024 22:49:21 GMT"} })
41252024-11-07T22:49:21.120ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41262024-11-07T22:49:21.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41272024-11-07T22:49:21.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41282024-11-07T22:49:21.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41292024-11-07T22:49:21.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41302024-11-07T22:49:21.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41312024-11-07T22:49:21.129ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 310.342814ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
41322024-11-07T22:49:21.129ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
41332024-11-07T22:49:21.129ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41342024-11-07T22:49:21.130ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8fddef7d-1715-4ddd-94b0-c3b4246e139f", "date": "Thu, 07 Nov 2024 22:49:21 GMT"} })
41352024-11-07T22:49:21.131ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 313.087989ms iteration = 15 status = {}
41362024-11-07T22:49:21.148ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 329.962914ms iteration = 14 status = {}
41372024-11-07T22:49:21.160ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41382024-11-07T22:49:21.160ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "df1c2357-b121-40d9-b905-7322915fade7", "content-length": "1", "date": "Thu, 07 Nov 2024 22:49:20 GMT"} })
41392024-11-07T22:49:21.162ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 343.864989ms iteration = 17 status = {"physical_disks_added":0}
41402024-11-07T22:49:21.162ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41412024-11-07T22:49:21.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41422024-11-07T22:49:21.168ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 350.008965ms iteration = 14 status = null
41432024-11-07T22:49:21.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41442024-11-07T22:49:21.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41452024-11-07T22:49:21.256ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41462024-11-07T22:49:21.258ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
41472024-11-07T22:49:21.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41482024-11-07T22:49:21.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41492024-11-07T22:49:21.271ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41502024-11-07T22:49:21.272ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2c2ccd1-79a0-4e2c-827e-2c6ae009c213", "content-length": "134", "date": "Thu, 07 Nov 2024 22:49:20 GMT"} })
41512024-11-07T22:49:21.272ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
41522024-11-07T22:49:21.272ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
41532024-11-07T22:49:21.272ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
41542024-11-07T22:49:21.272ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41552024-11-07T22:49:21.272ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41562024-11-07T22:49:21.272ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41572024-11-07T22:49:21.272ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41582024-11-07T22:49:21.272ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41592024-11-07T22:49:21.272ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41602024-11-07T22:49:21.272ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41612024-11-07T22:49:21.272ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
41622024-11-07T22:49:21.272ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41632024-11-07T22:49:21.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41642024-11-07T22:49:21.275ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
41652024-11-07T22:49:21.275ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5db253b-7811-4ad3-85b3-2d766603326d", "content-length": "2", "date": "Thu, 07 Nov 2024 22:49:20 GMT"} })
41662024-11-07T22:49:21.275ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41672024-11-07T22:49:21.275ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a03155f-5144-4308-bd36-eaed71ac411c", "content-length": "52", "date": "Thu, 07 Nov 2024 22:49:20 GMT"} })
41682024-11-07T22:49:21.275ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
41692024-11-07T22:49:21.275ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41702024-11-07T22:49:21.303ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b78c9c9-efc8-4a2d-9cad-30328d318b7d", "content-length": "691", "date": "Thu, 07 Nov 2024 22:49:21 GMT"} })
41712024-11-07T22:49:21.303ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
41722024-11-07T22:49:21.303ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
41732024-11-07T22:49:21.303ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
41742024-11-07T22:49:21.305ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 486.492438ms iteration = 14 status = {}
41752024-11-07T22:49:21.410ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dcc2541b-b4d8-411b-92fd-e2fa4a5afebf", "date": "Thu, 07 Nov 2024 22:49:21 GMT"} })
41762024-11-07T22:49:21.410ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
41772024-11-07T22:49:21.410ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41782024-11-07T22:49:21.415ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e490b623-76dc-4a93-9db4-ea2216e0fc48", "content-length": "682", "date": "Thu, 07 Nov 2024 22:49:21 GMT"} })
41792024-11-07T22:49:21.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41802024-11-07T22:49:21.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41812024-11-07T22:49:21.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41822024-11-07T22:49:21.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41832024-11-07T22:49:21.422ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41842024-11-07T22:49:21.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41852024-11-07T22:49:21.424ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41862024-11-07T22:49:21.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41872024-11-07T22:49:21.432ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 613.560126ms iteration = 14 status = {}
41882024-11-07T22:49:21.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 3b934694-d0c3-4cea-ae47-4c56518365aa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
41892024-11-07T22:49:21.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 3b934694-d0c3-4cea-ae47-4c56518365aa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
41902024-11-07T22:49:21.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 3b934694-d0c3-4cea-ae47-4c56518365aa response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
41912024-11-07T22:49:21.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8e60566d-f20b-460b-a282-664309ba24e1 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
41922024-11-07T22:49:21.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8e60566d-f20b-460b-a282-664309ba24e1 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
41932024-11-07T22:49:21.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1750 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8e60566d-f20b-460b-a282-664309ba24e1 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
41942024-11-07T22:49:22.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9ee60040-b833-411b-9bda-614f051b6cdb roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
41952024-11-07T22:49:22.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9ee60040-b833-411b-9bda-614f051b6cdb resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
41962024-11-07T22:49:22.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9ee60040-b833-411b-9bda-614f051b6cdb response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
41972024-11-07T22:49:23.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 934fdc9d-afea-4fe3-9452-1d06f186981f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
41982024-11-07T22:49:23.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 934fdc9d-afea-4fe3-9452-1d06f186981f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
41992024-11-07T22:49:23.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 934fdc9d-afea-4fe3-9452-1d06f186981f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42002024-11-07T22:49:24.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 84d7c77d-2ba5-4e27-b744-d7cbd733be49 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42012024-11-07T22:49:24.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 84d7c77d-2ba5-4e27-b744-d7cbd733be49 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42022024-11-07T22:49:24.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2661 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 84d7c77d-2ba5-4e27-b744-d7cbd733be49 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42032024-11-07T22:49:25.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f57167fb-67a5-4394-9f08-9d31c3267492 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42042024-11-07T22:49:25.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f57167fb-67a5-4394-9f08-9d31c3267492 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42052024-11-07T22:49:25.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f57167fb-67a5-4394-9f08-9d31c3267492 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42062024-11-07T22:49:26.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 775eadec-07ed-42ea-a6ea-4cadecaba7bb roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42072024-11-07T22:49:26.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 775eadec-07ed-42ea-a6ea-4cadecaba7bb resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42082024-11-07T22:49:26.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2678 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 775eadec-07ed-42ea-a6ea-4cadecaba7bb response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42092024-11-07T22:49:27.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4bc7f580-6ca9-43bd-9e3f-7544e37b0a0a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42102024-11-07T22:49:27.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4bc7f580-6ca9-43bd-9e3f-7544e37b0a0a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42112024-11-07T22:49:27.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4bc7f580-6ca9-43bd-9e3f-7544e37b0a0a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42122024-11-07T22:49:28.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 42cb8960-3cb9-428f-8bec-d90efe775f52 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42132024-11-07T22:49:28.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 42cb8960-3cb9-428f-8bec-d90efe775f52 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42142024-11-07T22:49:28.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 42cb8960-3cb9-428f-8bec-d90efe775f52 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42152024-11-07T22:49:29.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 68414b43-8595-422a-a33a-68058c53e0cf roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42162024-11-07T22:49:29.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 68414b43-8595-422a-a33a-68058c53e0cf resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42172024-11-07T22:49:29.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2501 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 68414b43-8595-422a-a33a-68058c53e0cf response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42182024-11-07T22:49:30.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
42192024-11-07T22:49:30.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42202024-11-07T22:49:30.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
42212024-11-07T22:49:30.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42222024-11-07T22:49:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42232024-11-07T22:49:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42242024-11-07T22:49:30.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42252024-11-07T22:49:30.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42262024-11-07T22:49:30.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42272024-11-07T22:49:30.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42282024-11-07T22:49:30.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42292024-11-07T22:49:30.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42302024-11-07T22:49:30.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42312024-11-07T22:49:30.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42322024-11-07T22:49:30.849ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.872713ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42332024-11-07T22:49:30.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42342024-11-07T22:49:30.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
42352024-11-07T22:49:30.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42362024-11-07T22:49:30.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42372024-11-07T22:49:30.868ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
42382024-11-07T22:49:30.868ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.65118ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
42392024-11-07T22:49:31.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 23a0ec00-43b1-46c8-8215-d5aaeb6fd403 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42402024-11-07T22:49:31.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 23a0ec00-43b1-46c8-8215-d5aaeb6fd403 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42412024-11-07T22:49:31.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2302 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 23a0ec00-43b1-46c8-8215-d5aaeb6fd403 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42422024-11-07T22:49:31.652ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1257 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = d73363cd-7cc9-4b6c-9270-174987bd7c74 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
42432024-11-07T22:49:32.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 086fb613-6b6b-45db-933b-479061a08ee7 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42442024-11-07T22:49:32.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 086fb613-6b6b-45db-933b-479061a08ee7 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42452024-11-07T22:49:32.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 086fb613-6b6b-45db-933b-479061a08ee7 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42462024-11-07T22:49:33.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c5176e13-9799-4c74-834a-884b4ae3e896 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42472024-11-07T22:49:33.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c5176e13-9799-4c74-834a-884b4ae3e896 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42482024-11-07T22:49:33.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c5176e13-9799-4c74-834a-884b4ae3e896 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42492024-11-07T22:49:34.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 95c8d38f-97d3-4830-8adc-a7b63d1c40bc roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42502024-11-07T22:49:34.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 95c8d38f-97d3-4830-8adc-a7b63d1c40bc resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42512024-11-07T22:49:34.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2438 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 95c8d38f-97d3-4830-8adc-a7b63d1c40bc response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42522024-11-07T22:49:35.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = aa62669c-7cec-4413-839a-7bb2a419b22e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42532024-11-07T22:49:35.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = aa62669c-7cec-4413-839a-7bb2a419b22e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42542024-11-07T22:49:35.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = aa62669c-7cec-4413-839a-7bb2a419b22e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42552024-11-07T22:49:36.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = be67343c-76dc-447e-a35c-d00fb78c99d9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42562024-11-07T22:49:36.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = be67343c-76dc-447e-a35c-d00fb78c99d9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42572024-11-07T22:49:36.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = be67343c-76dc-447e-a35c-d00fb78c99d9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42582024-11-07T22:49:36.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = f1f8b07c-6b71-48e3-8829-23ef4160c17d roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
42592024-11-07T22:49:36.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = f1f8b07c-6b71-48e3-8829-23ef4160c17d resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
42602024-11-07T22:49:36.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = f1f8b07c-6b71-48e3-8829-23ef4160c17d response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
42612024-11-07T22:49:36.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 11e70c81-6bec-4af7-aba8-f9d7085706d4 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
42622024-11-07T22:49:36.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 11e70c81-6bec-4af7-aba8-f9d7085706d4 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
42632024-11-07T22:49:36.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2054 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 11e70c81-6bec-4af7-aba8-f9d7085706d4 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
42642024-11-07T22:49:37.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0af8ab33-a50c-413d-a103-82b8c4fd24ca roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42652024-11-07T22:49:37.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0af8ab33-a50c-413d-a103-82b8c4fd24ca resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42662024-11-07T22:49:37.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0af8ab33-a50c-413d-a103-82b8c4fd24ca response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42672024-11-07T22:49:38.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 18e2588e-fb9c-400c-99be-59252c06af3a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42682024-11-07T22:49:38.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 18e2588e-fb9c-400c-99be-59252c06af3a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42692024-11-07T22:49:38.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1763 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 18e2588e-fb9c-400c-99be-59252c06af3a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42702024-11-07T22:49:39.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d21935b5-cccc-465c-80b7-d2bc14a53ed9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42712024-11-07T22:49:39.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d21935b5-cccc-465c-80b7-d2bc14a53ed9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42722024-11-07T22:49:39.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d21935b5-cccc-465c-80b7-d2bc14a53ed9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42732024-11-07T22:49:40.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 472c6045-f0fa-434d-8e07-ac2ef586ae3a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42742024-11-07T22:49:40.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 472c6045-f0fa-434d-8e07-ac2ef586ae3a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42752024-11-07T22:49:40.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1616 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 472c6045-f0fa-434d-8e07-ac2ef586ae3a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42762024-11-07T22:49:40.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
42772024-11-07T22:49:40.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
42782024-11-07T22:49:40.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42792024-11-07T22:49:40.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42802024-11-07T22:49:40.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42812024-11-07T22:49:40.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42822024-11-07T22:49:40.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42832024-11-07T22:49:40.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42842024-11-07T22:49:40.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42852024-11-07T22:49:40.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.215863ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42862024-11-07T22:49:40.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42872024-11-07T22:49:40.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42882024-11-07T22:49:40.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42892024-11-07T22:49:40.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42902024-11-07T22:49:40.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42912024-11-07T22:49:40.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42922024-11-07T22:49:40.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
42932024-11-07T22:49:40.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42942024-11-07T22:49:40.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42952024-11-07T22:49:40.839ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
42962024-11-07T22:49:40.839ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.633494ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
42972024-11-07T22:49:41.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4b5925b0-26f5-48f3-8bc0-021f5108935f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42982024-11-07T22:49:41.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4b5925b0-26f5-48f3-8bc0-021f5108935f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
42992024-11-07T22:49:41.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4b5925b0-26f5-48f3-8bc0-021f5108935f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43002024-11-07T22:49:42.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7470a866-1e59-4ff3-af33-9f87b27d879a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43012024-11-07T22:49:42.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7470a866-1e59-4ff3-af33-9f87b27d879a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43022024-11-07T22:49:42.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2676 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7470a866-1e59-4ff3-af33-9f87b27d879a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43032024-11-07T22:49:43.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1bf1eef3-7fe1-4ede-a8e9-2c9db90b14ed roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43042024-11-07T22:49:43.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1bf1eef3-7fe1-4ede-a8e9-2c9db90b14ed resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43052024-11-07T22:49:43.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1866 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1bf1eef3-7fe1-4ede-a8e9-2c9db90b14ed response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43062024-11-07T22:49:44.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 69c1ceb3-a02c-4412-9cb4-912e0328588b roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43072024-11-07T22:49:44.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 69c1ceb3-a02c-4412-9cb4-912e0328588b resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43082024-11-07T22:49:44.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 69c1ceb3-a02c-4412-9cb4-912e0328588b response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43092024-11-07T22:49:45.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9eb5de47-5765-45f6-974e-f44f1e8935a9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43102024-11-07T22:49:45.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9eb5de47-5765-45f6-974e-f44f1e8935a9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43112024-11-07T22:49:45.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9eb5de47-5765-45f6-974e-f44f1e8935a9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43122024-11-07T22:49:46.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 037854da-111b-4eea-b4c2-677423da4bcb roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43132024-11-07T22:49:46.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 037854da-111b-4eea-b4c2-677423da4bcb resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43142024-11-07T22:49:46.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2343 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 037854da-111b-4eea-b4c2-677423da4bcb response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43152024-11-07T22:49:46.653ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1291 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 098d0dfe-f8b4-432b-b6d5-fb34a3035090 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
43162024-11-07T22:49:47.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5b6a1345-dc80-48f9-b7d2-3c88691968ef roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43172024-11-07T22:49:47.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5b6a1345-dc80-48f9-b7d2-3c88691968ef resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43182024-11-07T22:49:47.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5b6a1345-dc80-48f9-b7d2-3c88691968ef response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43192024-11-07T22:49:48.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 897bf101-6e19-40d6-92be-761baebf452e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43202024-11-07T22:49:48.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 897bf101-6e19-40d6-92be-761baebf452e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43212024-11-07T22:49:48.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 897bf101-6e19-40d6-92be-761baebf452e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43222024-11-07T22:49:49.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 146cc892-aba6-41a3-a7d9-bc3adfaea453 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43232024-11-07T22:49:49.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 146cc892-aba6-41a3-a7d9-bc3adfaea453 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43242024-11-07T22:49:49.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 146cc892-aba6-41a3-a7d9-bc3adfaea453 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43252024-11-07T22:49:50.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 63f09042-2d88-449a-bfe2-00ce4a9df4bf roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43262024-11-07T22:49:50.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 63f09042-2d88-449a-bfe2-00ce4a9df4bf resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43272024-11-07T22:49:50.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1932 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 63f09042-2d88-449a-bfe2-00ce4a9df4bf response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
43282024-11-07T22:49:50.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
43292024-11-07T22:49:50.818ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
43302024-11-07T22:49:50.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
43312024-11-07T22:49:50.818ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
43322024-11-07T22:49:50.818ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43332024-11-07T22:49:50.818ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
43342024-11-07T22:49:50.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
43352024-11-07T22:49:50.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43362024-11-07T22:49:50.818ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
43372024-11-07T22:49:50.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
43382024-11-07T22:49:50.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43392024-11-07T22:49:50.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43402024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
43412024-11-07T22:49:50.819ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
43422024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43432024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
43442024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43452024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
43462024-11-07T22:49:50.819ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
43472024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43482024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
43492024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
43502024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43512024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
43522024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43532024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
43542024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43552024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
43562024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
43572024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43582024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
43592024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43602024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43612024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
43622024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43632024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
43642024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43652024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
43662024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43672024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
43682024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43692024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
43702024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
43712024-11-07T22:49:50.819ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531
43722024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
43732024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.91\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531"}
43742024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
43752024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43762024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
43772024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43782024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
43792024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
43802024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
43812024-11-07T22:49:50.819ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-07 22:39:50.819214135 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
43822024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43832024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
43842024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
43852024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
43862024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
43872024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
43882024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
43892024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
43902024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
43912024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43922024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43932024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
43942024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43952024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43962024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43972024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43982024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43992024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
44002024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44012024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44022024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44032024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44042024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44052024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44062024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44072024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44082024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44092024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
44102024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44112024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
44122024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
44132024-11-07T22:49:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
44142024-11-07T22:49:50.819ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a127151b-10b2-4835-91ce-b493ecd30481.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("de9282a1-0aa7-4ad8-a39a-58f19d05b651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1084, tv_nsec: 909053335 } })
44152024-11-07T22:49:50.819ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19da6a5b-073a-4e12-8775-91fc61c1e962.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1084, tv_nsec: 909158758 } })
44162024-11-07T22:49:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
44172024-11-07T22:49:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.066379ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
44182024-11-07T22:49:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
44192024-11-07T22:49:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.094269ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
44202024-11-07T22:49:50.821ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.092554ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
44212024-11-07T22:49:50.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44222024-11-07T22:49:50.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44232024-11-07T22:49:50.822ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1084, tv_nsec: 911662286 } })
44242024-11-07T22:49:50.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.760731ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
44252024-11-07T22:49:50.822ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
44262024-11-07T22:49:50.822ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44272024-11-07T22:49:50.823ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.881644ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
44282024-11-07T22:49:50.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44292024-11-07T22:49:50.824ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44302024-11-07T22:49:50.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44312024-11-07T22:49:50.826ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44322024-11-07T22:49:50.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44332024-11-07T22:49:50.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44342024-11-07T22:49:50.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
44352024-11-07T22:49:50.827ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44362024-11-07T22:49:50.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
44372024-11-07T22:49:50.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44382024-11-07T22:49:50.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44392024-11-07T22:49:50.828ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44402024-11-07T22:49:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
44412024-11-07T22:49:50.830ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44422024-11-07T22:49:50.830ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44432024-11-07T22:49:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44442024-11-07T22:49:50.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44452024-11-07T22:49:50.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
44462024-11-07T22:49:50.834ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44472024-11-07T22:49:50.834ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1084, tv_nsec: 923243578 } })
44482024-11-07T22:49:50.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44492024-11-07T22:49:50.834ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
44502024-11-07T22:49:50.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44512024-11-07T22:49:50.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44522024-11-07T22:49:50.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44532024-11-07T22:49:50.837ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44542024-11-07T22:49:50.838ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-07 22:39:50.819214135 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
44552024-11-07T22:49:50.838ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.154907ms iteration = 8 status = {"expiration":"2024-11-07T22:39:50.819214135Z","pruned":[]}
44562024-11-07T22:49:50.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 19.871116ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
44572024-11-07T22:49:50.839ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44582024-11-07T22:49:50.839ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44592024-11-07T22:49:50.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44602024-11-07T22:49:50.842ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44612024-11-07T22:49:50.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44622024-11-07T22:49:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44632024-11-07T22:49:50.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44642024-11-07T22:49:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44652024-11-07T22:49:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44662024-11-07T22:49:50.847ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44672024-11-07T22:49:50.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44682024-11-07T22:49:50.867ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44692024-11-07T22:49:50.867ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
44702024-11-07T22:49:50.867ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44712024-11-07T22:49:50.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44722024-11-07T22:49:50.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44732024-11-07T22:49:50.869ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44742024-11-07T22:49:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44752024-11-07T22:49:50.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44762024-11-07T22:49:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44772024-11-07T22:49:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
44782024-11-07T22:49:50.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44792024-11-07T22:49:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44802024-11-07T22:49:50.880ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44812024-11-07T22:49:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44822024-11-07T22:49:50.881ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
44832024-11-07T22:49:50.881ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
44842024-11-07T22:49:50.881ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 62.835276ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
44852024-11-07T22:49:50.882ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44862024-11-07T22:49:50.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44872024-11-07T22:49:50.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44882024-11-07T22:49:50.884ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44892024-11-07T22:49:50.886ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44902024-11-07T22:49:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44912024-11-07T22:49:50.886ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44922024-11-07T22:49:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44932024-11-07T22:49:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44942024-11-07T22:49:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44952024-11-07T22:49:50.886ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44962024-11-07T22:49:50.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44972024-11-07T22:49:50.887ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44982024-11-07T22:49:50.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44992024-11-07T22:49:50.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45002024-11-07T22:49:50.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45012024-11-07T22:49:50.893ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45022024-11-07T22:49:50.893ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1084, tv_nsec: 983142194 } })
45032024-11-07T22:49:50.894ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
45042024-11-07T22:49:50.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 76.036882ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45052024-11-07T22:49:50.896ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45062024-11-07T22:49:50.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45072024-11-07T22:49:50.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45082024-11-07T22:49:50.896ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
45092024-11-07T22:49:50.896ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
45102024-11-07T22:49:50.896ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 77.383458ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
45112024-11-07T22:49:50.898ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45122024-11-07T22:49:50.898ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
45132024-11-07T22:49:50.898ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
45142024-11-07T22:49:50.898ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
45152024-11-07T22:49:50.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45162024-11-07T22:49:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45172024-11-07T22:49:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45182024-11-07T22:49:50.900ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
45192024-11-07T22:49:50.901ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.992453ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
45202024-11-07T22:49:50.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45212024-11-07T22:49:50.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45222024-11-07T22:49:50.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45232024-11-07T22:49:50.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45242024-11-07T22:49:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
45252024-11-07T22:49:50.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45262024-11-07T22:49:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45272024-11-07T22:49:50.907ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45282024-11-07T22:49:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45292024-11-07T22:49:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45302024-11-07T22:49:50.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
45312024-11-07T22:49:50.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
45322024-11-07T22:49:50.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45332024-11-07T22:49:50.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
45342024-11-07T22:49:50.920ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45352024-11-07T22:49:50.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45362024-11-07T22:49:50.923ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 104.305705ms iteration = 15 status = 0
45372024-11-07T22:49:50.935ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
45382024-11-07T22:49:50.935ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
45392024-11-07T22:49:50.935ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
45402024-11-07T22:49:50.935ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45412024-11-07T22:49:50.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45422024-11-07T22:49:50.941ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45432024-11-07T22:49:50.941ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
45442024-11-07T22:49:50.941ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45452024-11-07T22:49:50.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45462024-11-07T22:49:50.943ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
45472024-11-07T22:49:50.943ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45482024-11-07T22:49:50.943ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
45492024-11-07T22:49:50.943ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 124.538381ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
45502024-11-07T22:49:50.944ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "924528ee-e3f8-445e-9c01-ba0424544035", "content-length": "26", "date": "Thu, 07 Nov 2024 22:49:50 GMT"} })
45512024-11-07T22:49:50.944ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45522024-11-07T22:49:50.944ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45532024-11-07T22:49:50.945ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
45542024-11-07T22:49:50.945ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 125.936809ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
45552024-11-07T22:49:50.946ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45562024-11-07T22:49:50.956ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45572024-11-07T22:49:50.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45582024-11-07T22:49:50.959ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45592024-11-07T22:49:50.959ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 140.526472ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45602024-11-07T22:49:50.960ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 141.405155ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
45612024-11-07T22:49:50.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45622024-11-07T22:49:50.961ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45632024-11-07T22:49:50.965ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
45642024-11-07T22:49:50.965ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45652024-11-07T22:49:50.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45662024-11-07T22:49:50.973ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
45672024-11-07T22:49:50.973ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 0 version = 2
45682024-11-07T22:49:50.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45692024-11-07T22:49:50.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45702024-11-07T22:49:50.980ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45712024-11-07T22:49:50.984ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45722024-11-07T22:49:50.984ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45732024-11-07T22:49:50.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45742024-11-07T22:49:50.996ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 1 version = 2
45752024-11-07T22:49:50.996ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
45762024-11-07T22:49:50.996ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-07 22:43:11.643428 UTC dns_group = external generation = 2
45772024-11-07T22:49:50.996ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 177.527821ms iteration = 9 status = {"generation":2}
45782024-11-07T22:49:50.999ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45792024-11-07T22:49:51.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45802024-11-07T22:49:51.000ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
45812024-11-07T22:49:51.024ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45822024-11-07T22:49:51.029ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 210.187852ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
45832024-11-07T22:49:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45842024-11-07T22:49:51.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45852024-11-07T22:49:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45862024-11-07T22:49:51.032ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
45872024-11-07T22:49:51.032ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
45882024-11-07T22:49:51.032ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45892024-11-07T22:49:51.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45902024-11-07T22:49:51.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45912024-11-07T22:49:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45922024-11-07T22:49:51.045ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45932024-11-07T22:49:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45942024-11-07T22:49:51.056ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
45952024-11-07T22:49:51.056ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
45962024-11-07T22:49:51.056ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-07 22:43:11.086261 UTC dns_group = internal generation = 1
45972024-11-07T22:49:51.056ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 237.365425ms iteration = 9 status = {"generation":1}
45982024-11-07T22:49:51.057ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-07T22:42:48.907310Z, time_modified: 2024-11-07T22:42:48.907310Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }) }
45992024-11-07T22:49:51.057ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 238.65848ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]}},"default_endpoint":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
46002024-11-07T22:49:51.083ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46012024-11-07T22:49:51.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46022024-11-07T22:49:51.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46032024-11-07T22:49:51.088ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46042024-11-07T22:49:51.088ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46052024-11-07T22:49:51.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46062024-11-07T22:49:51.089ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46072024-11-07T22:49:51.092ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46082024-11-07T22:49:51.092ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46092024-11-07T22:49:51.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46102024-11-07T22:49:51.100ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
46112024-11-07T22:49:51.100ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46122024-11-07T22:49:51.100ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "461d3ab2-5812-4b16-b9b5-ec9951d76783", "content-length": "26", "date": "Thu, 07 Nov 2024 22:49:50 GMT"} })
46132024-11-07T22:49:51.100ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46142024-11-07T22:49:51.103ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
46152024-11-07T22:49:51.108ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 289.540763ms iteration = 18 status = {"physical_disks_added":0}
46162024-11-07T22:49:51.113ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
46172024-11-07T22:49:51.113ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 294.426875ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
46182024-11-07T22:49:51.140ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
46192024-11-07T22:49:51.151ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46202024-11-07T22:49:51.151ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0536506-36a3-4f21-af24-07378496a15f", "content-length": "1", "date": "Thu, 07 Nov 2024 22:49:50 GMT"} })
46212024-11-07T22:49:51.153ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46222024-11-07T22:49:51.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46232024-11-07T22:49:51.155ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 336.936982ms iteration = 15 status = null
46242024-11-07T22:49:51.174ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
46252024-11-07T22:49:51.175ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46262024-11-07T22:49:51.175ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f6d5f8d-9bae-44d8-b266-bc6b762e5bf2", "content-length": "26", "date": "Thu, 07 Nov 2024 22:49:50 GMT"} })
46272024-11-07T22:49:51.175ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46282024-11-07T22:49:51.177ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46292024-11-07T22:49:51.190ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
46302024-11-07T22:49:51.326ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
46312024-11-07T22:49:51.326ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46322024-11-07T22:49:51.326ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b32007b1-adf9-4bfd-bf9d-e10dff49df41", "content-length": "372", "date": "Thu, 07 Nov 2024 22:49:51 GMT"} })
46332024-11-07T22:49:51.326ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46342024-11-07T22:49:51.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46352024-11-07T22:49:51.343ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 524.562835ms iteration = 15 status = {}
46362024-11-07T22:49:51.351ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46372024-11-07T22:49:51.352ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "77919e80-3414-4fa9-9043-0b6055007c6a", "content-length": "691", "date": "Thu, 07 Nov 2024 22:49:51 GMT"} })
46382024-11-07T22:49:51.352ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
46392024-11-07T22:49:51.352ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
46402024-11-07T22:49:51.352ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
46412024-11-07T22:49:51.354ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 535.45574ms iteration = 15 status = {}
46422024-11-07T22:49:51.367ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
46432024-11-07T22:49:51.368ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "473f52dc-63dc-4a10-8a9c-bed2e6325a9c", "date": "Thu, 07 Nov 2024 22:49:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46442024-11-07T22:49:51.368ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46452024-11-07T22:49:51.370ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2d72fb5d-51ea-4750-9622-8def1861dd28", "date": "Thu, 07 Nov 2024 22:49:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46462024-11-07T22:49:51.370ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46472024-11-07T22:49:51.372ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7de783ac-7cc1-48dd-868b-aa0d86f266ad", "date": "Thu, 07 Nov 2024 22:49:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46482024-11-07T22:49:51.372ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46492024-11-07T22:49:51.373ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
46502024-11-07T22:49:51.373ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
46512024-11-07T22:49:51.373ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 554.613606ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
46522024-11-07T22:49:51.374ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "54c422e3-60d8-4bfa-8bfe-e7e6f8592784", "date": "Thu, 07 Nov 2024 22:49:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46532024-11-07T22:49:51.374ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46542024-11-07T22:49:51.376ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "28b7a1c6-e504-4911-885a-8895ea314e01", "date": "Thu, 07 Nov 2024 22:49:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46552024-11-07T22:49:51.376ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46562024-11-07T22:49:51.378ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46572024-11-07T22:49:51.378ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 559.60635ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
46582024-11-07T22:49:51.394ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
46592024-11-07T22:49:51.394ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46602024-11-07T22:49:51.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46612024-11-07T22:49:51.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46622024-11-07T22:49:51.419ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
46632024-11-07T22:49:51.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46642024-11-07T22:49:51.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46652024-11-07T22:49:51.429ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46662024-11-07T22:49:51.429ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "718c4113-83d0-4f95-a772-80036117c695", "content-length": "134", "date": "Thu, 07 Nov 2024 22:49:51 GMT"} })
46672024-11-07T22:49:51.429ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46682024-11-07T22:49:51.429ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
46692024-11-07T22:49:51.429ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46702024-11-07T22:49:51.429ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46712024-11-07T22:49:51.429ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46722024-11-07T22:49:51.429ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46732024-11-07T22:49:51.429ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46742024-11-07T22:49:51.429ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46752024-11-07T22:49:51.429ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46762024-11-07T22:49:51.429ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46772024-11-07T22:49:51.429ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
46782024-11-07T22:49:51.429ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46792024-11-07T22:49:51.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46802024-11-07T22:49:51.432ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46812024-11-07T22:49:51.432ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "69040a33-3d7c-4c8d-8946-8a54393ddae8", "content-length": "2", "date": "Thu, 07 Nov 2024 22:49:51 GMT"} })
46822024-11-07T22:49:51.432ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46832024-11-07T22:49:51.432ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "52083b66-7336-4f0d-9654-e1b5bced7ffd", "content-length": "52", "date": "Thu, 07 Nov 2024 22:49:51 GMT"} })
46842024-11-07T22:49:51.432ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
46852024-11-07T22:49:51.432ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46862024-11-07T22:49:51.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ac6d022c-8075-40be-8462-a3ebf492d7dc roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
46872024-11-07T22:49:51.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ac6d022c-8075-40be-8462-a3ebf492d7dc resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
46882024-11-07T22:49:51.478ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7f0bb95b-c149-47e5-bc05-eeb418ee728f", "date": "Thu, 07 Nov 2024 22:49:51 GMT"} })
46892024-11-07T22:49:51.478ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46902024-11-07T22:49:51.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46912024-11-07T22:49:51.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ac6d022c-8075-40be-8462-a3ebf492d7dc response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
46922024-11-07T22:49:51.481ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46932024-11-07T22:49:51.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46942024-11-07T22:49:51.484ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46952024-11-07T22:49:51.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46962024-11-07T22:49:51.488ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
46972024-11-07T22:49:51.488ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46982024-11-07T22:49:51.490ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4507f255-70b1-4818-b292-7444c3cf7abe", "date": "Thu, 07 Nov 2024 22:49:51 GMT"} })
46992024-11-07T22:49:51.492ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 673.207056ms iteration = 16 status = {}
47002024-11-07T22:49:51.586ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0ac742cd-ec47-47d2-b8ec-d7b26c19ffdf", "date": "Thu, 07 Nov 2024 22:49:51 GMT"} })
47012024-11-07T22:49:51.586ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
47022024-11-07T22:49:51.586ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
47032024-11-07T22:49:51.590ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b62b9c77-9539-4eef-9fb4-3829367520f4", "content-length": "682", "date": "Thu, 07 Nov 2024 22:49:51 GMT"} })
47042024-11-07T22:49:51.590ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47052024-11-07T22:49:51.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47062024-11-07T22:49:51.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47072024-11-07T22:49:51.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47082024-11-07T22:49:51.599ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47092024-11-07T22:49:51.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47102024-11-07T22:49:51.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47112024-11-07T22:49:51.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47122024-11-07T22:49:51.608ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 789.890464ms iteration = 15 status = {}
47132024-11-07T22:49:51.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 4fbe95db-a7e3-4822-bac3-2e457ea737c6 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
47142024-11-07T22:49:51.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 4fbe95db-a7e3-4822-bac3-2e457ea737c6 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
47152024-11-07T22:49:51.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 4fbe95db-a7e3-4822-bac3-2e457ea737c6 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
47162024-11-07T22:49:51.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 52be6331-bcb4-46a8-9d69-072a656e2cf3 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
47172024-11-07T22:49:51.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 52be6331-bcb4-46a8-9d69-072a656e2cf3 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
47182024-11-07T22:49:51.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 52be6331-bcb4-46a8-9d69-072a656e2cf3 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
47192024-11-07T22:49:51.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = f8d668f0-1435-4ce9-91b5-552eecbfd2ea roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
47202024-11-07T22:49:51.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = f8d668f0-1435-4ce9-91b5-552eecbfd2ea resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
47212024-11-07T22:49:51.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = f8d668f0-1435-4ce9-91b5-552eecbfd2ea response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
47222024-11-07T22:49:52.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8afcb901-ef0b-4a5f-824a-2665e0587c6a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47232024-11-07T22:49:52.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8afcb901-ef0b-4a5f-824a-2665e0587c6a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47242024-11-07T22:49:52.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2451 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8afcb901-ef0b-4a5f-824a-2665e0587c6a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47252024-11-07T22:49:53.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 10bd9d5e-d015-48e3-8f56-052b75870650 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47262024-11-07T22:49:53.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 10bd9d5e-d015-48e3-8f56-052b75870650 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47272024-11-07T22:49:53.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2393 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 10bd9d5e-d015-48e3-8f56-052b75870650 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47282024-11-07T22:49:54.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 68eb85d7-79eb-4c14-b054-5e73ad0a5d1f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47292024-11-07T22:49:54.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 68eb85d7-79eb-4c14-b054-5e73ad0a5d1f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47302024-11-07T22:49:54.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 68eb85d7-79eb-4c14-b054-5e73ad0a5d1f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47312024-11-07T22:49:55.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 996177a5-9ae7-4fb0-88ed-99d899c23fac roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47322024-11-07T22:49:55.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 996177a5-9ae7-4fb0-88ed-99d899c23fac resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47332024-11-07T22:49:55.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 996177a5-9ae7-4fb0-88ed-99d899c23fac response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47342024-11-07T22:49:56.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 31aed798-12ff-4adf-a76e-2b8e5af3f471 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47352024-11-07T22:49:56.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 31aed798-12ff-4adf-a76e-2b8e5af3f471 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47362024-11-07T22:49:56.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1669 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 31aed798-12ff-4adf-a76e-2b8e5af3f471 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47372024-11-07T22:49:57.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 77272a68-f65d-4683-a24f-4cdec72f9e1c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47382024-11-07T22:49:57.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 77272a68-f65d-4683-a24f-4cdec72f9e1c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47392024-11-07T22:49:57.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1882 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 77272a68-f65d-4683-a24f-4cdec72f9e1c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47402024-11-07T22:49:58.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 800707c0-f1a3-4b72-bea3-768bafe4a07a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47412024-11-07T22:49:58.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 800707c0-f1a3-4b72-bea3-768bafe4a07a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47422024-11-07T22:49:58.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 800707c0-f1a3-4b72-bea3-768bafe4a07a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47432024-11-07T22:49:59.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fd029a46-d236-4cc0-9e29-a1df47d4d1b8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47442024-11-07T22:49:59.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fd029a46-d236-4cc0-9e29-a1df47d4d1b8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47452024-11-07T22:49:59.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fd029a46-d236-4cc0-9e29-a1df47d4d1b8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47462024-11-07T22:50:00.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e0163291-f741-442e-9503-11795d013afa roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47472024-11-07T22:50:00.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e0163291-f741-442e-9503-11795d013afa resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47482024-11-07T22:50:00.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2036 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e0163291-f741-442e-9503-11795d013afa response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47492024-11-07T22:50:00.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
47502024-11-07T22:50:00.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
47512024-11-07T22:50:00.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47522024-11-07T22:50:00.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47532024-11-07T22:50:00.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47542024-11-07T22:50:00.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47552024-11-07T22:50:00.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47562024-11-07T22:50:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47572024-11-07T22:50:00.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47582024-11-07T22:50:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47592024-11-07T22:50:00.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47602024-11-07T22:50:00.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47612024-11-07T22:50:00.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47622024-11-07T22:50:00.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47632024-11-07T22:50:00.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47642024-11-07T22:50:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
47652024-11-07T22:50:00.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47662024-11-07T22:50:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47672024-11-07T22:50:00.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
47682024-11-07T22:50:00.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.240855ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
47692024-11-07T22:50:00.887ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.736254ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47702024-11-07T22:50:01.653ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 542dbacb-493a-422f-87f4-58d59419baf0 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
47712024-11-07T22:50:01.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c001ae40-5712-44b3-acf7-35981fd329a0 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47722024-11-07T22:50:01.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c001ae40-5712-44b3-acf7-35981fd329a0 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47732024-11-07T22:50:01.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c001ae40-5712-44b3-acf7-35981fd329a0 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47742024-11-07T22:50:02.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ab8d52dc-da94-4b84-bb28-30013b248fdd roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47752024-11-07T22:50:02.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ab8d52dc-da94-4b84-bb28-30013b248fdd resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47762024-11-07T22:50:02.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1962 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ab8d52dc-da94-4b84-bb28-30013b248fdd response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47772024-11-07T22:50:03.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f40e40f9-b65f-4657-8c9f-116450c756b8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47782024-11-07T22:50:03.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f40e40f9-b65f-4657-8c9f-116450c756b8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47792024-11-07T22:50:03.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2602 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f40e40f9-b65f-4657-8c9f-116450c756b8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47802024-11-07T22:50:04.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ad721f74-5411-4d50-9509-1fea3ddb94f6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47812024-11-07T22:50:04.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ad721f74-5411-4d50-9509-1fea3ddb94f6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47822024-11-07T22:50:04.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ad721f74-5411-4d50-9509-1fea3ddb94f6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47832024-11-07T22:50:05.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1521c27e-e459-4ca2-a209-39eaa9472de9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47842024-11-07T22:50:05.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1521c27e-e459-4ca2-a209-39eaa9472de9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47852024-11-07T22:50:05.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1802 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1521c27e-e459-4ca2-a209-39eaa9472de9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47862024-11-07T22:50:06.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 0063a658-3068-407c-b829-a96b8713282c roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
47872024-11-07T22:50:06.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 0063a658-3068-407c-b829-a96b8713282c resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
47882024-11-07T22:50:06.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 0063a658-3068-407c-b829-a96b8713282c response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
47892024-11-07T22:50:06.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 9b3bfa9d-1ddd-4373-bda5-f4c96d82e751 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
47902024-11-07T22:50:06.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 9b3bfa9d-1ddd-4373-bda5-f4c96d82e751 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
47912024-11-07T22:50:06.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 9b3bfa9d-1ddd-4373-bda5-f4c96d82e751 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
47922024-11-07T22:50:06.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c1dbd3d7-7102-4915-92d9-152f0bf264bf roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47932024-11-07T22:50:06.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c1dbd3d7-7102-4915-92d9-152f0bf264bf resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47942024-11-07T22:50:06.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c1dbd3d7-7102-4915-92d9-152f0bf264bf response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47952024-11-07T22:50:07.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 46e76481-8913-4315-b96f-2b78645b5efe roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47962024-11-07T22:50:07.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 46e76481-8913-4315-b96f-2b78645b5efe resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47972024-11-07T22:50:07.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 46e76481-8913-4315-b96f-2b78645b5efe response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47982024-11-07T22:50:08.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9fbee7c8-5dac-4c15-a247-378cd531c22f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
47992024-11-07T22:50:08.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9fbee7c8-5dac-4c15-a247-378cd531c22f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48002024-11-07T22:50:08.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1945 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9fbee7c8-5dac-4c15-a247-378cd531c22f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48012024-11-07T22:50:09.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3db53d20-340f-47ca-bfcf-a84dd67e947c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48022024-11-07T22:50:09.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3db53d20-340f-47ca-bfcf-a84dd67e947c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48032024-11-07T22:50:09.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2179 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3db53d20-340f-47ca-bfcf-a84dd67e947c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48042024-11-07T22:50:10.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
48052024-11-07T22:50:10.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
48062024-11-07T22:50:10.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48072024-11-07T22:50:10.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48082024-11-07T22:50:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48092024-11-07T22:50:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48102024-11-07T22:50:10.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48112024-11-07T22:50:10.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48122024-11-07T22:50:10.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48132024-11-07T22:50:10.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48142024-11-07T22:50:10.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48152024-11-07T22:50:10.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48162024-11-07T22:50:10.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48172024-11-07T22:50:10.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
48182024-11-07T22:50:10.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48192024-11-07T22:50:10.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48202024-11-07T22:50:10.839ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
48212024-11-07T22:50:10.839ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.082709ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
48222024-11-07T22:50:10.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48232024-11-07T22:50:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48242024-11-07T22:50:10.879ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.185251ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48252024-11-07T22:50:10.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 59fd5c82-2845-4c67-94cf-803d46b781bf roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48262024-11-07T22:50:10.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 59fd5c82-2845-4c67-94cf-803d46b781bf resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48272024-11-07T22:50:10.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1906 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 59fd5c82-2845-4c67-94cf-803d46b781bf response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48282024-11-07T22:50:11.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2948b372-1286-4e66-8df6-fa887652db3e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48292024-11-07T22:50:11.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2948b372-1286-4e66-8df6-fa887652db3e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48302024-11-07T22:50:11.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1831 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2948b372-1286-4e66-8df6-fa887652db3e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48312024-11-07T22:50:12.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d5af0167-1116-40ce-8539-8f99bae6efc3 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48322024-11-07T22:50:12.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d5af0167-1116-40ce-8539-8f99bae6efc3 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48332024-11-07T22:50:12.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d5af0167-1116-40ce-8539-8f99bae6efc3 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48342024-11-07T22:50:13.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 83db2515-e2b8-4c9b-865e-2a490a7c07a8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48352024-11-07T22:50:13.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 83db2515-e2b8-4c9b-865e-2a490a7c07a8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48362024-11-07T22:50:13.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1759 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 83db2515-e2b8-4c9b-865e-2a490a7c07a8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48372024-11-07T22:50:15.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cacbb9bd-3859-422b-a0e4-420f153132c3 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48382024-11-07T22:50:15.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cacbb9bd-3859-422b-a0e4-420f153132c3 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48392024-11-07T22:50:15.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cacbb9bd-3859-422b-a0e4-420f153132c3 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48402024-11-07T22:50:16.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 39f75a49-7431-42db-8c27-9333c125c550 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48412024-11-07T22:50:16.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 39f75a49-7431-42db-8c27-9333c125c550 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48422024-11-07T22:50:16.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 39f75a49-7431-42db-8c27-9333c125c550 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48432024-11-07T22:50:16.653ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1403 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = e8b3f700-ae78-49f4-950a-7cfc7073b6ac response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
48442024-11-07T22:50:17.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ab911d70-7b5b-4108-9867-3a0cc683c287 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48452024-11-07T22:50:17.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ab911d70-7b5b-4108-9867-3a0cc683c287 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48462024-11-07T22:50:17.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2179 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ab911d70-7b5b-4108-9867-3a0cc683c287 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48472024-11-07T22:50:18.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 36191ae3-e3e6-4b6e-838d-87b6519800b6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48482024-11-07T22:50:18.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 36191ae3-e3e6-4b6e-838d-87b6519800b6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48492024-11-07T22:50:18.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1704 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 36191ae3-e3e6-4b6e-838d-87b6519800b6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48502024-11-07T22:50:19.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9e57dd6d-bc06-4f2d-a4c7-c9381741ba33 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48512024-11-07T22:50:19.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9e57dd6d-bc06-4f2d-a4c7-c9381741ba33 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48522024-11-07T22:50:19.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9e57dd6d-bc06-4f2d-a4c7-c9381741ba33 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48532024-11-07T22:50:20.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6bf9a55b-e057-430e-94eb-67f57016742c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48542024-11-07T22:50:20.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6bf9a55b-e057-430e-94eb-67f57016742c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48552024-11-07T22:50:20.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2154 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6bf9a55b-e057-430e-94eb-67f57016742c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
48562024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
48572024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
48582024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
48592024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48602024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48612024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48622024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
48632024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48642024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
48652024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
48662024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
48672024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
48682024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48692024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
48702024-11-07T22:50:20.818ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
48712024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
48722024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48732024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48742024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
48752024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
48762024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48772024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48782024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
48792024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48802024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
48812024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48822024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
48832024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
48842024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
48852024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48862024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48872024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
48882024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48892024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
48902024-11-07T22:50:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48912024-11-07T22:50:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48922024-11-07T22:50:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
48932024-11-07T22:50:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48942024-11-07T22:50:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48952024-11-07T22:50:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48962024-11-07T22:50:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48972024-11-07T22:50:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
48982024-11-07T22:50:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
48992024-11-07T22:50:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49002024-11-07T22:50:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49012024-11-07T22:50:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49022024-11-07T22:50:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49032024-11-07T22:50:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49042024-11-07T22:50:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49052024-11-07T22:50:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49062024-11-07T22:50:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49072024-11-07T22:50:20.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49082024-11-07T22:50:20.822ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.914736ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49092024-11-07T22:50:20.822ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49102024-11-07T22:50:20.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49112024-11-07T22:50:20.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49122024-11-07T22:50:20.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49132024-11-07T22:50:20.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49142024-11-07T22:50:20.828ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1114, tv_nsec: 917595596 } })
49152024-11-07T22:50:20.828ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49162024-11-07T22:50:20.828ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
49172024-11-07T22:50:20.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49182024-11-07T22:50:20.830ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49192024-11-07T22:50:20.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49202024-11-07T22:50:20.832ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1114, tv_nsec: 922147799 } })
49212024-11-07T22:50:20.833ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
49222024-11-07T22:50:20.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49232024-11-07T22:50:20.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49242024-11-07T22:50:20.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49252024-11-07T22:50:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49262024-11-07T22:50:20.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49272024-11-07T22:50:20.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49282024-11-07T22:50:20.860ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1114, tv_nsec: 949311682 } })
49292024-11-07T22:50:20.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
49302024-11-07T22:50:20.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49312024-11-07T22:50:20.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 44.639194ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
49322024-11-07T22:50:20.864ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49332024-11-07T22:50:20.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49342024-11-07T22:50:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49352024-11-07T22:50:20.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49362024-11-07T22:50:20.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49372024-11-07T22:50:20.869ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49382024-11-07T22:50:20.869ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49392024-11-07T22:50:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49402024-11-07T22:50:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49412024-11-07T22:50:20.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49422024-11-07T22:50:20.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49432024-11-07T22:50:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49442024-11-07T22:50:20.870ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49452024-11-07T22:50:20.870ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
49462024-11-07T22:50:20.870ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49472024-11-07T22:50:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49482024-11-07T22:50:20.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49492024-11-07T22:50:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49502024-11-07T22:50:20.871ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.409695ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49512024-11-07T22:50:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49522024-11-07T22:50:20.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49532024-11-07T22:50:20.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49542024-11-07T22:50:20.874ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49552024-11-07T22:50:20.874ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
49562024-11-07T22:50:20.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49572024-11-07T22:50:20.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49582024-11-07T22:50:20.875ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.038459ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
49592024-11-07T22:50:20.876ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49602024-11-07T22:50:20.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49612024-11-07T22:50:20.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49622024-11-07T22:50:20.879ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49632024-11-07T22:50:20.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49642024-11-07T22:50:20.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49652024-11-07T22:50:20.882ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49662024-11-07T22:50:20.882ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49672024-11-07T22:50:20.882ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49682024-11-07T22:50:20.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49692024-11-07T22:50:20.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49702024-11-07T22:50:20.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49712024-11-07T22:50:20.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49722024-11-07T22:50:20.891ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49732024-11-07T22:50:20.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49742024-11-07T22:50:20.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
49752024-11-07T22:50:20.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49762024-11-07T22:50:20.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49772024-11-07T22:50:20.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 76.678969ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49782024-11-07T22:50:20.909ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
49792024-11-07T22:50:20.909ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 90.960404ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
49802024-11-07T22:50:20.913ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
49812024-11-07T22:50:20.913ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49822024-11-07T22:50:20.913ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "148c4fd4-ead6-4bdb-aa00-52546fa47910", "content-length": "26", "date": "Thu, 07 Nov 2024 22:50:20 GMT"} })
49832024-11-07T22:50:20.913ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49842024-11-07T22:50:20.915ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49852024-11-07T22:50:20.918ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
49862024-11-07T22:50:20.918ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 99.962527ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
49872024-11-07T22:50:20.920ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
49882024-11-07T22:50:20.920ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49892024-11-07T22:50:20.920ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "28443b61-beb7-4231-9c88-94af81f311cb", "content-length": "26", "date": "Thu, 07 Nov 2024 22:50:20 GMT"} })
49902024-11-07T22:50:20.920ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49912024-11-07T22:50:20.921ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49922024-11-07T22:50:20.921ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
49932024-11-07T22:50:20.921ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 102.598499ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
49942024-11-07T22:50:20.922ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 103.793511ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
49952024-11-07T22:50:20.922ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49962024-11-07T22:50:20.938ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
49972024-11-07T22:50:20.938ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49982024-11-07T22:50:20.938ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d2771c9-59ed-49ef-94ce-2852e1728e05", "content-length": "26", "date": "Thu, 07 Nov 2024 22:50:20 GMT"} })
49992024-11-07T22:50:20.938ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50002024-11-07T22:50:20.941ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
50012024-11-07T22:50:20.941ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50022024-11-07T22:50:20.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50032024-11-07T22:50:20.944ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50042024-11-07T22:50:20.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50052024-11-07T22:50:20.946ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50062024-11-07T22:50:20.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 128.875927ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
50072024-11-07T22:50:20.949ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
50082024-11-07T22:50:20.949ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50092024-11-07T22:50:20.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50102024-11-07T22:50:20.953ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 134.246472ms iteration = 16 status = 0
50112024-11-07T22:50:20.953ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 134.281624ms iteration = 19 status = {"physical_disks_added":0}
50122024-11-07T22:50:20.985ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50132024-11-07T22:50:20.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50142024-11-07T22:50:21.009ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50152024-11-07T22:50:21.009ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "18a5f638-f065-4cf7-87f5-85d88b59d5a8", "content-length": "1", "date": "Thu, 07 Nov 2024 22:50:20 GMT"} })
50162024-11-07T22:50:21.011ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50172024-11-07T22:50:21.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50182024-11-07T22:50:21.047ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 229.228075ms iteration = 16 status = {}
50192024-11-07T22:50:21.057ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
50202024-11-07T22:50:21.057ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50212024-11-07T22:50:21.057ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4023a998-f88e-4ac2-99f2-ce67314d7a07", "content-length": "372", "date": "Thu, 07 Nov 2024 22:50:21 GMT"} })
50222024-11-07T22:50:21.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50232024-11-07T22:50:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50242024-11-07T22:50:21.059ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 240.644273ms iteration = 16 status = null
50252024-11-07T22:50:21.112ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
50262024-11-07T22:50:21.112ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
50272024-11-07T22:50:21.112ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d87e044f-2081-4c1e-bd4e-f22dc24550db", "date": "Thu, 07 Nov 2024 22:50:21 GMT"} })
50282024-11-07T22:50:21.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50292024-11-07T22:50:21.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50302024-11-07T22:50:21.115ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50312024-11-07T22:50:21.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50322024-11-07T22:50:21.116ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50332024-11-07T22:50:21.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50342024-11-07T22:50:21.118ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50352024-11-07T22:50:21.118ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50362024-11-07T22:50:21.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50372024-11-07T22:50:21.120ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50382024-11-07T22:50:21.120ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50392024-11-07T22:50:21.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50402024-11-07T22:50:21.121ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
50412024-11-07T22:50:21.121ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50422024-11-07T22:50:21.121ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2f433a8d-7e7c-4e35-87f9-ea70eb095360", "date": "Thu, 07 Nov 2024 22:50:21 GMT"} })
50432024-11-07T22:50:21.123ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 304.595679ms iteration = 17 status = {}
50442024-11-07T22:50:21.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4718f6c5-836d-488b-a6b7-e626787f3941 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
50452024-11-07T22:50:21.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4718f6c5-836d-488b-a6b7-e626787f3941 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
50462024-11-07T22:50:21.147ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50472024-11-07T22:50:21.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50482024-11-07T22:50:21.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4718f6c5-836d-488b-a6b7-e626787f3941 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
50492024-11-07T22:50:21.150ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
50502024-11-07T22:50:21.150ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50512024-11-07T22:50:21.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50522024-11-07T22:50:21.156ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50532024-11-07T22:50:21.158ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50542024-11-07T22:50:21.158ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50552024-11-07T22:50:21.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50562024-11-07T22:50:21.161ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50572024-11-07T22:50:21.162ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "67ba520f-b7b3-49ca-b304-298c1f2b3ce0", "content-length": "134", "date": "Thu, 07 Nov 2024 22:50:20 GMT"} })
50582024-11-07T22:50:21.162ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
50592024-11-07T22:50:21.162ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
50602024-11-07T22:50:21.162ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
50612024-11-07T22:50:21.162ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50622024-11-07T22:50:21.162ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50632024-11-07T22:50:21.162ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50642024-11-07T22:50:21.162ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50652024-11-07T22:50:21.162ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50662024-11-07T22:50:21.162ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50672024-11-07T22:50:21.162ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50682024-11-07T22:50:21.162ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
50692024-11-07T22:50:21.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50702024-11-07T22:50:21.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50712024-11-07T22:50:21.164ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
50722024-11-07T22:50:21.164ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2abf351c-cb83-4eba-bec6-a2a537d420cf", "content-length": "2", "date": "Thu, 07 Nov 2024 22:50:20 GMT"} })
50732024-11-07T22:50:21.165ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
50742024-11-07T22:50:21.165ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1605b11d-5cd0-417f-9460-221740ff5a70", "content-length": "52", "date": "Thu, 07 Nov 2024 22:50:20 GMT"} })
50752024-11-07T22:50:21.165ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
50762024-11-07T22:50:21.165ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
50772024-11-07T22:50:21.195ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50782024-11-07T22:50:21.195ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "54c8e493-3b59-47ec-8f96-c2fc2b91296d", "content-length": "691", "date": "Thu, 07 Nov 2024 22:50:21 GMT"} })
50792024-11-07T22:50:21.195ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
50802024-11-07T22:50:21.195ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
50812024-11-07T22:50:21.195ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
50822024-11-07T22:50:21.197ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 378.444363ms iteration = 16 status = {}
50832024-11-07T22:50:21.369ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bc10c43b-da83-4f65-b634-63a8549164a7", "date": "Thu, 07 Nov 2024 22:50:21 GMT"} })
50842024-11-07T22:50:21.369ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
50852024-11-07T22:50:21.369ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
50862024-11-07T22:50:21.375ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5eb95299-b5a1-4d96-b6ac-88748bbfc42f", "content-length": "682", "date": "Thu, 07 Nov 2024 22:50:21 GMT"} })
50872024-11-07T22:50:21.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50882024-11-07T22:50:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50892024-11-07T22:50:21.379ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50902024-11-07T22:50:21.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50912024-11-07T22:50:21.382ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50922024-11-07T22:50:21.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50932024-11-07T22:50:21.384ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50942024-11-07T22:50:21.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50952024-11-07T22:50:21.392ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 574.015798ms iteration = 16 status = {}
50962024-11-07T22:50:21.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 05cb9737-dc5e-436f-b09d-62b1fbae42db roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
50972024-11-07T22:50:21.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 05cb9737-dc5e-436f-b09d-62b1fbae42db resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
50982024-11-07T22:50:21.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 05cb9737-dc5e-436f-b09d-62b1fbae42db response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
50992024-11-07T22:50:21.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 93c538fb-09cd-435f-901d-76f531ec439a roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
51002024-11-07T22:50:21.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 93c538fb-09cd-435f-901d-76f531ec439a resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
51012024-11-07T22:50:21.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 93c538fb-09cd-435f-901d-76f531ec439a response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
51022024-11-07T22:50:21.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 70d79415-3c70-4148-8428-c7560db3ac6c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
51032024-11-07T22:50:21.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 70d79415-3c70-4148-8428-c7560db3ac6c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
51042024-11-07T22:50:21.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3355 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 70d79415-3c70-4148-8428-c7560db3ac6c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
51052024-11-07T22:50:22.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6d54dbfd-4c96-40a6-81b9-529377c93bd9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51062024-11-07T22:50:22.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6d54dbfd-4c96-40a6-81b9-529377c93bd9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51072024-11-07T22:50:22.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1714 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6d54dbfd-4c96-40a6-81b9-529377c93bd9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51082024-11-07T22:50:23.214ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:45490
51092024-11-07T22:50:23.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9b6e9139-b917-4a98-b7f1-37189031fdc2 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51102024-11-07T22:50:23.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9b6e9139-b917-4a98-b7f1-37189031fdc2 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51112024-11-07T22:50:23.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45490 req_id = e7ebed1b-3a63-4baa-a289-0aa11ec34dbd roles = RoleSet { roles: {} } uri = /metrics/producers
51122024-11-07T22:50:23.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45490 req_id = e7ebed1b-3a63-4baa-a289-0aa11ec34dbd resource = Database result = Ok(()) uri = /metrics/producers
51132024-11-07T22:50:23.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9b6e9139-b917-4a98-b7f1-37189031fdc2 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51142024-11-07T22:50:23.252ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51152024-11-07T22:50:23.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37238 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45490 req_id = e7ebed1b-3a63-4baa-a289-0aa11ec34dbd response_code = 201 uri = /metrics/producers
51162024-11-07T22:50:24.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2a905af8-9968-49b0-8e09-396e8265b534 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51172024-11-07T22:50:24.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2a905af8-9968-49b0-8e09-396e8265b534 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51182024-11-07T22:50:24.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2a905af8-9968-49b0-8e09-396e8265b534 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51192024-11-07T22:50:25.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ca489878-04bf-4946-b836-c105dffe44d7 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51202024-11-07T22:50:25.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ca489878-04bf-4946-b836-c105dffe44d7 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51212024-11-07T22:50:25.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2056 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ca489878-04bf-4946-b836-c105dffe44d7 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51222024-11-07T22:50:26.264ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:53294
51232024-11-07T22:50:26.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53294 req_id = 16843262-cdc4-4995-b1e2-86fe351540b1 roles = RoleSet { roles: {} } uri = /metrics/producers
51242024-11-07T22:50:26.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53294 req_id = 16843262-cdc4-4995-b1e2-86fe351540b1 resource = Database result = Ok(()) uri = /metrics/producers
51252024-11-07T22:50:26.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7f01405d-65e0-4402-ac19-21407a71fada roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51262024-11-07T22:50:26.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7f01405d-65e0-4402-ac19-21407a71fada resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51272024-11-07T22:50:26.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7f01405d-65e0-4402-ac19-21407a71fada response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51282024-11-07T22:50:26.308ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 9e471274-19dd-4f92-b383-47c4daa65273
51292024-11-07T22:50:26.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43715 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53294 req_id = 16843262-cdc4-4995-b1e2-86fe351540b1 response_code = 201 uri = /metrics/producers
51302024-11-07T22:50:27.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 51fc8aaf-d411-4d53-a61f-a6ce379da137 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51312024-11-07T22:50:27.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 51fc8aaf-d411-4d53-a61f-a6ce379da137 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51322024-11-07T22:50:27.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 51fc8aaf-d411-4d53-a61f-a6ce379da137 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51332024-11-07T22:50:27.624ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:53823
51342024-11-07T22:50:27.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53823 req_id = bf41a65f-3126-4f7a-b337-727f9ac38864 roles = RoleSet { roles: {} } uri = /metrics/producers
51352024-11-07T22:50:27.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53823 req_id = bf41a65f-3126-4f7a-b337-727f9ac38864 resource = Database result = Ok(()) uri = /metrics/producers
51362024-11-07T22:50:27.673ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 815e7211-42cf-4415-8116-29d4376e1760
51372024-11-07T22:50:27.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48260 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53823 req_id = bf41a65f-3126-4f7a-b337-727f9ac38864 response_code = 201 uri = /metrics/producers
51382024-11-07T22:50:28.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 836b2d94-04a7-497e-8aa8-3bc01e381dd8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51392024-11-07T22:50:28.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 836b2d94-04a7-497e-8aa8-3bc01e381dd8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51402024-11-07T22:50:28.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 836b2d94-04a7-497e-8aa8-3bc01e381dd8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51412024-11-07T22:50:29.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8b8d2d3d-8ae8-419d-ad3b-d4060f31a07a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51422024-11-07T22:50:29.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8b8d2d3d-8ae8-419d-ad3b-d4060f31a07a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51432024-11-07T22:50:29.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1734 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8b8d2d3d-8ae8-419d-ad3b-d4060f31a07a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51442024-11-07T22:50:29.954ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:48932
51452024-11-07T22:50:29.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48932 req_id = 14eaf140-6f84-44fa-8db6-2db338262f36 roles = RoleSet { roles: {} } uri = /metrics/producers
51462024-11-07T22:50:29.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48932 req_id = 14eaf140-6f84-44fa-8db6-2db338262f36 resource = Database result = Ok(()) uri = /metrics/producers
51472024-11-07T22:50:29.989ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 43a27374-6630-4b8d-a3e3-a2857df923bd
51482024-11-07T22:50:29.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34878 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48932 req_id = 14eaf140-6f84-44fa-8db6-2db338262f36 response_code = 201 uri = /metrics/producers
51492024-11-07T22:50:30.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b60a38b9-8207-4d06-81b7-0cd52fbdc320 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51502024-11-07T22:50:30.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b60a38b9-8207-4d06-81b7-0cd52fbdc320 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51512024-11-07T22:50:30.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b60a38b9-8207-4d06-81b7-0cd52fbdc320 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51522024-11-07T22:50:30.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
51532024-11-07T22:50:30.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
51542024-11-07T22:50:30.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51552024-11-07T22:50:30.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51562024-11-07T22:50:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51572024-11-07T22:50:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51582024-11-07T22:50:30.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51592024-11-07T22:50:30.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51602024-11-07T22:50:30.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51612024-11-07T22:50:30.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51622024-11-07T22:50:30.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51632024-11-07T22:50:30.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51642024-11-07T22:50:30.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51652024-11-07T22:50:30.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
51662024-11-07T22:50:30.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51672024-11-07T22:50:30.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51682024-11-07T22:50:30.838ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
51692024-11-07T22:50:30.838ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.059741ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
51702024-11-07T22:50:30.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51712024-11-07T22:50:30.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51722024-11-07T22:50:30.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.423964ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51732024-11-07T22:50:31.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4cc7fdf9-56d0-46d3-9412-0a73d0e8677c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51742024-11-07T22:50:31.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4cc7fdf9-56d0-46d3-9412-0a73d0e8677c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51752024-11-07T22:50:31.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4cc7fdf9-56d0-46d3-9412-0a73d0e8677c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51762024-11-07T22:50:31.653ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1306 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = c34bfd43-2916-439d-92dd-828c4c2d6817 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
51772024-11-07T22:50:32.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 702d395a-c213-47f6-be37-a0c7a0df9aa6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51782024-11-07T22:50:32.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 702d395a-c213-47f6-be37-a0c7a0df9aa6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51792024-11-07T22:50:32.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 702d395a-c213-47f6-be37-a0c7a0df9aa6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51802024-11-07T22:50:33.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 89c4bf34-b476-4962-8a39-5329401577d3 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51812024-11-07T22:50:33.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 89c4bf34-b476-4962-8a39-5329401577d3 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51822024-11-07T22:50:33.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 89c4bf34-b476-4962-8a39-5329401577d3 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51832024-11-07T22:50:34.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = da335c34-29c8-46e5-8c25-ae869b9ab0f4 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51842024-11-07T22:50:34.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = da335c34-29c8-46e5-8c25-ae869b9ab0f4 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51852024-11-07T22:50:34.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = da335c34-29c8-46e5-8c25-ae869b9ab0f4 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51862024-11-07T22:50:35.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5d992512-8fe6-4699-9c52-2a7a6301af68 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51872024-11-07T22:50:35.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5d992512-8fe6-4699-9c52-2a7a6301af68 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51882024-11-07T22:50:35.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1837 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5d992512-8fe6-4699-9c52-2a7a6301af68 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51892024-11-07T22:50:36.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b0cfc6ba-4491-43bb-a8fa-4d635eb1596a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51902024-11-07T22:50:36.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b0cfc6ba-4491-43bb-a8fa-4d635eb1596a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51912024-11-07T22:50:36.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b0cfc6ba-4491-43bb-a8fa-4d635eb1596a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51922024-11-07T22:50:37.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3a357d63-3879-4b66-9c1b-3abc0a35c7bd roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51932024-11-07T22:50:37.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3a357d63-3879-4b66-9c1b-3abc0a35c7bd resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51942024-11-07T22:50:37.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1764 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3a357d63-3879-4b66-9c1b-3abc0a35c7bd response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51952024-11-07T22:50:38.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 115619fc-17cc-476a-b6f5-a75469993267 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51962024-11-07T22:50:38.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 115619fc-17cc-476a-b6f5-a75469993267 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51972024-11-07T22:50:38.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 115619fc-17cc-476a-b6f5-a75469993267 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51982024-11-07T22:50:39.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 411a9477-37f3-4d4d-9668-5c3a9922bdb7 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
51992024-11-07T22:50:39.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 411a9477-37f3-4d4d-9668-5c3a9922bdb7 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52002024-11-07T22:50:39.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 411a9477-37f3-4d4d-9668-5c3a9922bdb7 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52012024-11-07T22:50:40.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 07547ec9-72cc-4e9d-b1fa-da03d02f83d0 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52022024-11-07T22:50:40.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 07547ec9-72cc-4e9d-b1fa-da03d02f83d0 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52032024-11-07T22:50:40.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1918 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 07547ec9-72cc-4e9d-b1fa-da03d02f83d0 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52042024-11-07T22:50:40.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
52052024-11-07T22:50:40.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
52062024-11-07T22:50:40.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52072024-11-07T22:50:40.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52082024-11-07T22:50:40.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52092024-11-07T22:50:40.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52102024-11-07T22:50:40.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52112024-11-07T22:50:40.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52122024-11-07T22:50:40.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52132024-11-07T22:50:40.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52142024-11-07T22:50:40.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52152024-11-07T22:50:40.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52162024-11-07T22:50:40.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52172024-11-07T22:50:40.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52182024-11-07T22:50:40.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52192024-11-07T22:50:40.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
52202024-11-07T22:50:40.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52212024-11-07T22:50:40.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52222024-11-07T22:50:40.838ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
52232024-11-07T22:50:40.838ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.612669ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
52242024-11-07T22:50:40.849ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.868943ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52252024-11-07T22:50:41.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 744b8f7f-cd28-4b20-b5cd-d6952c3ec605 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52262024-11-07T22:50:41.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 744b8f7f-cd28-4b20-b5cd-d6952c3ec605 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52272024-11-07T22:50:41.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1880 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 744b8f7f-cd28-4b20-b5cd-d6952c3ec605 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52282024-11-07T22:50:42.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ea19de6a-45eb-425d-97d7-ed42c38c252e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52292024-11-07T22:50:42.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ea19de6a-45eb-425d-97d7-ed42c38c252e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52302024-11-07T22:50:42.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ea19de6a-45eb-425d-97d7-ed42c38c252e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52312024-11-07T22:50:42.767ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
52322024-11-07T22:50:42.767ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
52332024-11-07T22:50:42.797ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
52342024-11-07T22:50:42.798ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:55994
52352024-11-07T22:50:42.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:55994 req_id = 3e600fe7-fb50-4aa9-a01a-17992156a99e roles = RoleSet { roles: {} } uri = /metrics/producers
52362024-11-07T22:50:42.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:55994 req_id = 3e600fe7-fb50-4aa9-a01a-17992156a99e resource = Database result = Ok(()) uri = /metrics/producers
52372024-11-07T22:50:42.807ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 377e4941-a34d-4c51-b725-3cc833f8df14
52382024-11-07T22:50:42.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9032 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:55994 req_id = 3e600fe7-fb50-4aa9-a01a-17992156a99e response_code = 201 uri = /metrics/producers
52392024-11-07T22:50:42.807ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "3e600fe7-fb50-4aa9-a01a-17992156a99e", "content-length": "41", "date": "Thu, 07 Nov 2024 22:50:42 GMT"} })
52402024-11-07T22:50:42.808ZDEBGnexus (producer-registration-task): registered with nexus successfully
52412024-11-07T22:50:42.808ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
52422024-11-07T22:50:43.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 78d38c60-ac5a-4020-be69-94b935a3ec26 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52432024-11-07T22:50:43.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 78d38c60-ac5a-4020-be69-94b935a3ec26 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52442024-11-07T22:50:43.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 78d38c60-ac5a-4020-be69-94b935a3ec26 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52452024-11-07T22:50:44.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2b8afa7b-32ff-4059-acff-be99818d3c79 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52462024-11-07T22:50:44.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2b8afa7b-32ff-4059-acff-be99818d3c79 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52472024-11-07T22:50:44.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2b8afa7b-32ff-4059-acff-be99818d3c79 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52482024-11-07T22:50:45.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = af712f79-2a44-4f48-906b-b33f8311b5df roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52492024-11-07T22:50:45.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = af712f79-2a44-4f48-906b-b33f8311b5df resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52502024-11-07T22:50:45.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = af712f79-2a44-4f48-906b-b33f8311b5df response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52512024-11-07T22:50:46.655ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1631 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = ba670a80-92ec-408d-a278-b69fd6fc97ca response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
52522024-11-07T22:50:46.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6cff25fb-31f4-4cb7-9052-82c8d513ae1c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52532024-11-07T22:50:46.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6cff25fb-31f4-4cb7-9052-82c8d513ae1c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52542024-11-07T22:50:46.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6cff25fb-31f4-4cb7-9052-82c8d513ae1c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52552024-11-07T22:50:47.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 74b331d2-ccd0-41e3-aab6-60d803973bb8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52562024-11-07T22:50:47.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 74b331d2-ccd0-41e3-aab6-60d803973bb8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52572024-11-07T22:50:47.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 74b331d2-ccd0-41e3-aab6-60d803973bb8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52582024-11-07T22:50:48.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2f6344f2-80e2-4b4f-9656-083f796c1f44 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52592024-11-07T22:50:48.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2f6344f2-80e2-4b4f-9656-083f796c1f44 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52602024-11-07T22:50:48.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2138 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2f6344f2-80e2-4b4f-9656-083f796c1f44 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52612024-11-07T22:50:49.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0a5a6dce-5fe4-4358-9c55-8f3149da5ff8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52622024-11-07T22:50:49.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0a5a6dce-5fe4-4358-9c55-8f3149da5ff8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52632024-11-07T22:50:49.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0a5a6dce-5fe4-4358-9c55-8f3149da5ff8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
52642024-11-07T22:50:50.818ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
52652024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
52662024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52672024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
52682024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
52692024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
52702024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
52712024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
52722024-11-07T22:50:50.819ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-07 22:40:50.819047781 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
52732024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
52742024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
52752024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
52762024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
52772024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
52782024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
52792024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52802024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
52812024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52822024-11-07T22:50:50.819ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531
52832024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.801\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531"}
52842024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
52852024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52862024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
52872024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
52882024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52892024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
52902024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52912024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
52922024-11-07T22:50:50.819ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
52932024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52942024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
52952024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
52962024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
52972024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
52982024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
52992024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
53002024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
53012024-11-07T22:50:50.819ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
53022024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53032024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
53042024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
53052024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53062024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53072024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53082024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
53092024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
53102024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53112024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
53122024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53132024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
53142024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53152024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53162024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
53172024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53182024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
53192024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53202024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
53212024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53222024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
53232024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53242024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
53252024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53262024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
53272024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
53282024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53292024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
53302024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53312024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53322024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53332024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53342024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53352024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53362024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53372024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53382024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
53392024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53402024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53412024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53422024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
53432024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53442024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53452024-11-07T22:50:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53462024-11-07T22:50:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53472024-11-07T22:50:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53482024-11-07T22:50:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53492024-11-07T22:50:50.820ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19da6a5b-073a-4e12-8775-91fc61c1e962.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1144, tv_nsec: 909286442 } })
53502024-11-07T22:50:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53512024-11-07T22:50:50.820ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a127151b-10b2-4835-91ce-b493ecd30481.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("de9282a1-0aa7-4ad8-a39a-58f19d05b651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1144, tv_nsec: 909322783 } })
53522024-11-07T22:50:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
53532024-11-07T22:50:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.311995ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
53542024-11-07T22:50:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
53552024-11-07T22:50:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.50826ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
53562024-11-07T22:50:50.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53572024-11-07T22:50:50.822ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
53582024-11-07T22:50:50.822ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
53592024-11-07T22:50:50.822ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 3.541285ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
53602024-11-07T22:50:50.823ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.182433ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53612024-11-07T22:50:50.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53622024-11-07T22:50:50.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53632024-11-07T22:50:50.823ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-07 22:40:50.819047781 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
53642024-11-07T22:50:50.823ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.760419ms iteration = 9 status = {"expiration":"2024-11-07T22:40:50.819047781Z","pruned":[]}
53652024-11-07T22:50:50.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53662024-11-07T22:50:50.824ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53672024-11-07T22:50:50.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53682024-11-07T22:50:50.825ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53692024-11-07T22:50:50.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53702024-11-07T22:50:50.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53712024-11-07T22:50:50.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53722024-11-07T22:50:50.827ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1144, tv_nsec: 916670541 } })
53732024-11-07T22:50:50.827ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
53742024-11-07T22:50:50.829ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53752024-11-07T22:50:50.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53762024-11-07T22:50:50.832ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53772024-11-07T22:50:50.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53782024-11-07T22:50:50.832ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53792024-11-07T22:50:50.833ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.930176ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
53802024-11-07T22:50:50.834ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
53812024-11-07T22:50:50.834ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53822024-11-07T22:50:50.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53832024-11-07T22:50:50.834ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1144, tv_nsec: 924248625 } })
53842024-11-07T22:50:50.835ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
53852024-11-07T22:50:50.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 19.240299ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
53862024-11-07T22:50:50.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53872024-11-07T22:50:50.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53882024-11-07T22:50:50.840ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53892024-11-07T22:50:50.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53902024-11-07T22:50:50.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0aa341b0-c86b-4d66-a85e-bd198714ec04 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
53912024-11-07T22:50:50.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0aa341b0-c86b-4d66-a85e-bd198714ec04 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
53922024-11-07T22:50:50.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53932024-11-07T22:50:50.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53942024-11-07T22:50:50.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0aa341b0-c86b-4d66-a85e-bd198714ec04 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
53952024-11-07T22:50:50.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53962024-11-07T22:50:50.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53972024-11-07T22:50:50.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53982024-11-07T22:50:50.879ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53992024-11-07T22:50:50.879ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54002024-11-07T22:50:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54012024-11-07T22:50:50.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54022024-11-07T22:50:50.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54032024-11-07T22:50:50.884ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54042024-11-07T22:50:50.884ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 65.680092ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
54052024-11-07T22:50:50.885ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54062024-11-07T22:50:50.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54072024-11-07T22:50:50.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54082024-11-07T22:50:50.885ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54092024-11-07T22:50:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54102024-11-07T22:50:50.886ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54112024-11-07T22:50:50.886ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
54122024-11-07T22:50:50.886ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54132024-11-07T22:50:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54142024-11-07T22:50:50.886ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54152024-11-07T22:50:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54162024-11-07T22:50:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54172024-11-07T22:50:50.887ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54182024-11-07T22:50:50.887ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54192024-11-07T22:50:50.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54202024-11-07T22:50:50.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54212024-11-07T22:50:50.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54222024-11-07T22:50:50.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54232024-11-07T22:50:50.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54242024-11-07T22:50:50.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54252024-11-07T22:50:50.890ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54262024-11-07T22:50:50.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54272024-11-07T22:50:50.891ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.002414ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
54282024-11-07T22:50:50.892ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54292024-11-07T22:50:50.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54302024-11-07T22:50:50.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54312024-11-07T22:50:50.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54322024-11-07T22:50:50.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54332024-11-07T22:50:50.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54342024-11-07T22:50:50.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54352024-11-07T22:50:50.896ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54362024-11-07T22:50:50.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54372024-11-07T22:50:50.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54382024-11-07T22:50:50.898ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54392024-11-07T22:50:50.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54402024-11-07T22:50:50.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54412024-11-07T22:50:50.901ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54422024-11-07T22:50:50.901ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54432024-11-07T22:50:50.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54442024-11-07T22:50:50.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54452024-11-07T22:50:50.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54462024-11-07T22:50:50.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54472024-11-07T22:50:50.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
54482024-11-07T22:50:50.902ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54492024-11-07T22:50:50.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54502024-11-07T22:50:50.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54512024-11-07T22:50:50.903ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54522024-11-07T22:50:50.903ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.415258ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54532024-11-07T22:50:50.906ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1144, tv_nsec: 995387555 } })
54542024-11-07T22:50:50.906ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
54552024-11-07T22:50:50.911ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54562024-11-07T22:50:50.913ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54572024-11-07T22:50:50.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54582024-11-07T22:50:50.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54592024-11-07T22:50:50.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54602024-11-07T22:50:50.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
54612024-11-07T22:50:50.917ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54622024-11-07T22:50:50.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54632024-11-07T22:50:50.946ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
54642024-11-07T22:50:50.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
54652024-11-07T22:50:50.950ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54662024-11-07T22:50:50.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54672024-11-07T22:50:50.964ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 145.027194ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
54682024-11-07T22:50:50.964ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
54692024-11-07T22:50:50.964ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
54702024-11-07T22:50:50.964ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
54712024-11-07T22:50:50.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54722024-11-07T22:50:50.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54732024-11-07T22:50:50.978ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
54742024-11-07T22:50:50.978ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
54752024-11-07T22:50:50.978ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
54762024-11-07T22:50:50.978ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54772024-11-07T22:50:50.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54782024-11-07T22:50:50.998ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
54792024-11-07T22:50:51.054ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
54802024-11-07T22:50:51.054ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54812024-11-07T22:50:51.054ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef02f82f-538b-46c0-841b-d3559524bd4e", "content-length": "26", "date": "Thu, 07 Nov 2024 22:50:51 GMT"} })
54822024-11-07T22:50:51.054ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54832024-11-07T22:50:51.057ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54842024-11-07T22:50:51.075ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
54852024-11-07T22:50:51.075ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54862024-11-07T22:50:51.076ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bdfda8c-408d-4d22-bc29-bf7912e47153", "content-length": "26", "date": "Thu, 07 Nov 2024 22:50:51 GMT"} })
54872024-11-07T22:50:51.076ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54882024-11-07T22:50:51.078ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
54892024-11-07T22:50:51.078ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54902024-11-07T22:50:51.078ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "08650bc6-9519-4527-aa4c-381b3d1f555d", "content-length": "372", "date": "Thu, 07 Nov 2024 22:50:51 GMT"} })
54912024-11-07T22:50:51.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54922024-11-07T22:50:51.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54932024-11-07T22:50:51.081ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 261.610949ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54942024-11-07T22:50:51.082ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54952024-11-07T22:50:51.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54962024-11-07T22:50:51.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54972024-11-07T22:50:51.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54982024-11-07T22:50:51.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54992024-11-07T22:50:51.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
55002024-11-07T22:50:51.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55012024-11-07T22:50:51.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55022024-11-07T22:50:51.090ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
55032024-11-07T22:50:51.091ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
55042024-11-07T22:50:51.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55052024-11-07T22:50:51.093ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55062024-11-07T22:50:51.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55072024-11-07T22:50:51.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55082024-11-07T22:50:51.093ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55092024-11-07T22:50:51.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55102024-11-07T22:50:51.105ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 286.710587ms iteration = 20 status = {"physical_disks_added":0}
55112024-11-07T22:50:51.116ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
55122024-11-07T22:50:51.116ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55132024-11-07T22:50:51.116ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
55142024-11-07T22:50:51.116ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 297.531009ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
55152024-11-07T22:50:51.116ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5efd45f6-aa3f-421a-a02c-c90a0402ebd1", "content-length": "26", "date": "Thu, 07 Nov 2024 22:50:51 GMT"} })
55162024-11-07T22:50:51.116ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55172024-11-07T22:50:51.118ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55182024-11-07T22:50:51.129ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55192024-11-07T22:50:51.129ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55202024-11-07T22:50:51.129ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 310.402656ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55212024-11-07T22:50:51.131ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55222024-11-07T22:50:51.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55232024-11-07T22:50:51.134ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55242024-11-07T22:50:51.139ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
55252024-11-07T22:50:51.139ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55262024-11-07T22:50:51.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55272024-11-07T22:50:51.143ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
55282024-11-07T22:50:51.143ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
55292024-11-07T22:50:51.143ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 324.583229ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
55302024-11-07T22:50:51.148ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 329.521962ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
55312024-11-07T22:50:51.150ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55322024-11-07T22:50:51.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55332024-11-07T22:50:51.153ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55342024-11-07T22:50:51.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55352024-11-07T22:50:51.172ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
55362024-11-07T22:50:51.172ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
55372024-11-07T22:50:51.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55382024-11-07T22:50:51.173ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
55392024-11-07T22:50:51.173ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 0 version = 2
55402024-11-07T22:50:51.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55412024-11-07T22:50:51.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55422024-11-07T22:50:51.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55432024-11-07T22:50:51.175ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55442024-11-07T22:50:51.175ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55452024-11-07T22:50:51.179ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
55462024-11-07T22:50:51.179ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
55472024-11-07T22:50:51.179ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f840942c-ca4d-4f8f-a6b0-0c13d21923fb", "date": "Thu, 07 Nov 2024 22:50:51 GMT"} })
55482024-11-07T22:50:51.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55492024-11-07T22:50:51.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55502024-11-07T22:50:51.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55512024-11-07T22:50:51.180ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55522024-11-07T22:50:51.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55532024-11-07T22:50:51.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55542024-11-07T22:50:51.181ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55552024-11-07T22:50:51.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55562024-11-07T22:50:51.183ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 1 version = 2
55572024-11-07T22:50:51.183ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
55582024-11-07T22:50:51.183ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-07 22:43:11.643428 UTC dns_group = external generation = 2
55592024-11-07T22:50:51.183ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 364.193758ms iteration = 10 status = {"generation":2}
55602024-11-07T22:50:51.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55612024-11-07T22:50:51.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55622024-11-07T22:50:51.184ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
55632024-11-07T22:50:51.184ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
55642024-11-07T22:50:51.184ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-07 22:43:11.086261 UTC dns_group = internal generation = 1
55652024-11-07T22:50:51.184ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 364.906917ms iteration = 10 status = {"generation":1}
55662024-11-07T22:50:51.186ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55672024-11-07T22:50:51.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55682024-11-07T22:50:51.192ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55692024-11-07T22:50:51.193ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
55702024-11-07T22:50:51.193ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 373.851559ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
55712024-11-07T22:50:51.195ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
55722024-11-07T22:50:51.195ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55732024-11-07T22:50:51.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55742024-11-07T22:50:51.196ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-07T22:42:48.907310Z, time_modified: 2024-11-07T22:42:48.907310Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }) }
55752024-11-07T22:50:51.196ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 376.745967ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]}},"default_endpoint":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
55762024-11-07T22:50:51.238ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
55772024-11-07T22:50:51.238ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "cf03266e-fc83-4917-a960-c2cc439c862a", "date": "Thu, 07 Nov 2024 22:50:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55782024-11-07T22:50:51.238ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55792024-11-07T22:50:51.240ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0c13e2c3-7c0e-42f7-a592-ee99cdfb425f", "date": "Thu, 07 Nov 2024 22:50:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55802024-11-07T22:50:51.240ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55812024-11-07T22:50:51.242ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55822024-11-07T22:50:51.242ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 423.228891ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
55832024-11-07T22:50:51.304ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
55842024-11-07T22:50:51.337ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 517.954497ms iteration = 17 status = {}
55852024-11-07T22:50:51.351ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55862024-11-07T22:50:51.351ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c629d098-50cd-4f2b-935a-5fb261272529", "content-length": "1", "date": "Thu, 07 Nov 2024 22:50:51 GMT"} })
55872024-11-07T22:50:51.353ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55882024-11-07T22:50:51.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55892024-11-07T22:50:51.355ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
55902024-11-07T22:50:51.355ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a187bde2-b1a2-4c6d-92ba-c26b13a73637", "content-length": "691", "date": "Thu, 07 Nov 2024 22:50:51 GMT"} })
55912024-11-07T22:50:51.355ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
55922024-11-07T22:50:51.355ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
55932024-11-07T22:50:51.355ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
55942024-11-07T22:50:51.357ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 537.856014ms iteration = 17 status = {}
55952024-11-07T22:50:51.358ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 539.150538ms iteration = 17 status = 0
55962024-11-07T22:50:51.359ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 539.867408ms iteration = 17 status = null
55972024-11-07T22:50:51.359ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
55982024-11-07T22:50:51.359ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55992024-11-07T22:50:51.359ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d090a6cc-4f5e-4880-b930-5c7b265b0c34", "date": "Thu, 07 Nov 2024 22:50:51 GMT"} })
56002024-11-07T22:50:51.361ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 542.255182ms iteration = 18 status = {}
56012024-11-07T22:50:51.385ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
56022024-11-07T22:50:51.386ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5c8d7389-5586-488b-a5f2-c1a6322ffaf6", "date": "Thu, 07 Nov 2024 22:50:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56032024-11-07T22:50:51.386ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56042024-11-07T22:50:51.388ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "24b3a544-943d-4d71-8ec3-9986228380a3", "date": "Thu, 07 Nov 2024 22:50:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56052024-11-07T22:50:51.388ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56062024-11-07T22:50:51.390ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b664b783-7144-45de-ad43-6e27f193197d", "date": "Thu, 07 Nov 2024 22:50:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56072024-11-07T22:50:51.390ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56082024-11-07T22:50:51.392ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
56092024-11-07T22:50:51.392ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 573.340531ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
56102024-11-07T22:50:51.413ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56112024-11-07T22:50:51.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56122024-11-07T22:50:51.415ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
56132024-11-07T22:50:51.415ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56142024-11-07T22:50:51.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56152024-11-07T22:50:51.425ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56162024-11-07T22:50:51.425ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "957164ff-e9f2-465d-b8fe-b42da3d48cdd", "content-length": "134", "date": "Thu, 07 Nov 2024 22:50:51 GMT"} })
56172024-11-07T22:50:51.425ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
56182024-11-07T22:50:51.425ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
56192024-11-07T22:50:51.425ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
56202024-11-07T22:50:51.425ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56212024-11-07T22:50:51.425ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56222024-11-07T22:50:51.425ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56232024-11-07T22:50:51.425ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56242024-11-07T22:50:51.425ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56252024-11-07T22:50:51.425ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56262024-11-07T22:50:51.425ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56272024-11-07T22:50:51.426ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
56282024-11-07T22:50:51.426ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56292024-11-07T22:50:51.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56302024-11-07T22:50:51.428ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56312024-11-07T22:50:51.428ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c3ecba5-1048-42d9-95d9-d9c71806b41f", "content-length": "2", "date": "Thu, 07 Nov 2024 22:50:51 GMT"} })
56322024-11-07T22:50:51.428ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56332024-11-07T22:50:51.428ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3029ecc5-6ee0-49d1-b924-5fef50932b79", "content-length": "52", "date": "Thu, 07 Nov 2024 22:50:51 GMT"} })
56342024-11-07T22:50:51.428ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
56352024-11-07T22:50:51.428ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56362024-11-07T22:50:51.534ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e15d4d25-3f49-41d5-a0a4-0d38aa6e5001", "date": "Thu, 07 Nov 2024 22:50:51 GMT"} })
56372024-11-07T22:50:51.534ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
56382024-11-07T22:50:51.534ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56392024-11-07T22:50:51.535ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fd119a3-c9ed-4573-9676-a30e53e8862d", "content-length": "682", "date": "Thu, 07 Nov 2024 22:50:51 GMT"} })
56402024-11-07T22:50:51.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56412024-11-07T22:50:51.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56422024-11-07T22:50:51.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56432024-11-07T22:50:51.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56442024-11-07T22:50:51.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56452024-11-07T22:50:51.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56462024-11-07T22:50:51.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56472024-11-07T22:50:51.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56482024-11-07T22:50:51.553ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 733.914683ms iteration = 17 status = {}
56492024-11-07T22:50:51.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 9b141f04-6b6b-43fc-8624-a91eaf77a55d roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
56502024-11-07T22:50:51.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 9b141f04-6b6b-43fc-8624-a91eaf77a55d resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
56512024-11-07T22:50:51.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 9b141f04-6b6b-43fc-8624-a91eaf77a55d response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
56522024-11-07T22:50:51.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 2306e4ea-21ca-4887-b027-559e6ebaee07 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
56532024-11-07T22:50:51.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 2306e4ea-21ca-4887-b027-559e6ebaee07 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
56542024-11-07T22:50:51.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 2306e4ea-21ca-4887-b027-559e6ebaee07 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
56552024-11-07T22:50:51.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = b5bd5d81-6601-46ab-859a-b8639d042926 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
56562024-11-07T22:50:51.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = b5bd5d81-6601-46ab-859a-b8639d042926 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
56572024-11-07T22:50:51.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3305 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = b5bd5d81-6601-46ab-859a-b8639d042926 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
56582024-11-07T22:50:51.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1ded17c8-4add-456d-8a89-2c82ebdd0c97 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56592024-11-07T22:50:51.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1ded17c8-4add-456d-8a89-2c82ebdd0c97 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56602024-11-07T22:50:51.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1ded17c8-4add-456d-8a89-2c82ebdd0c97 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56612024-11-07T22:50:52.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 21238ec1-965b-41cc-99a9-b4a1c75e9843 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56622024-11-07T22:50:52.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 21238ec1-965b-41cc-99a9-b4a1c75e9843 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56632024-11-07T22:50:52.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 21238ec1-965b-41cc-99a9-b4a1c75e9843 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56642024-11-07T22:50:53.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a40fb57f-b381-4fbc-98aa-785e0ffbe062 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56652024-11-07T22:50:53.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a40fb57f-b381-4fbc-98aa-785e0ffbe062 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56662024-11-07T22:50:53.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a40fb57f-b381-4fbc-98aa-785e0ffbe062 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56672024-11-07T22:50:54.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4be5895b-25e7-4b64-93a6-359f4a56ae60 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56682024-11-07T22:50:54.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4be5895b-25e7-4b64-93a6-359f4a56ae60 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56692024-11-07T22:50:54.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2691 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4be5895b-25e7-4b64-93a6-359f4a56ae60 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56702024-11-07T22:50:55.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e012465a-2d3f-4e64-be53-06f22bdad026 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56712024-11-07T22:50:55.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e012465a-2d3f-4e64-be53-06f22bdad026 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56722024-11-07T22:50:55.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2587 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e012465a-2d3f-4e64-be53-06f22bdad026 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56732024-11-07T22:50:57.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a2d3d0ea-d2b7-486c-9beb-899607e4c81c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56742024-11-07T22:50:57.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a2d3d0ea-d2b7-486c-9beb-899607e4c81c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56752024-11-07T22:50:57.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a2d3d0ea-d2b7-486c-9beb-899607e4c81c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56762024-11-07T22:50:58.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b83546bb-6524-409b-b00f-a162ab75e303 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56772024-11-07T22:50:58.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b83546bb-6524-409b-b00f-a162ab75e303 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56782024-11-07T22:50:58.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2340 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b83546bb-6524-409b-b00f-a162ab75e303 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56792024-11-07T22:50:59.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cf075996-e3ce-429d-9e34-380417696beb roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56802024-11-07T22:50:59.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cf075996-e3ce-429d-9e34-380417696beb resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56812024-11-07T22:50:59.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cf075996-e3ce-429d-9e34-380417696beb response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56822024-11-07T22:51:00.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d9f713b1-1f2f-4ff9-89d5-a5fd01abfbd3 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56832024-11-07T22:51:00.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d9f713b1-1f2f-4ff9-89d5-a5fd01abfbd3 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56842024-11-07T22:51:00.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d9f713b1-1f2f-4ff9-89d5-a5fd01abfbd3 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
56852024-11-07T22:51:00.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
56862024-11-07T22:51:00.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
56872024-11-07T22:51:00.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56882024-11-07T22:51:00.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56892024-11-07T22:51:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56902024-11-07T22:51:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56912024-11-07T22:51:00.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56922024-11-07T22:51:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56932024-11-07T22:51:00.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56942024-11-07T22:51:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56952024-11-07T22:51:00.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56962024-11-07T22:51:00.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56972024-11-07T22:51:00.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56982024-11-07T22:51:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56992024-11-07T22:51:00.849ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.38754ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57002024-11-07T22:51:00.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57012024-11-07T22:51:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
57022024-11-07T22:51:00.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57032024-11-07T22:51:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57042024-11-07T22:51:00.866ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
57052024-11-07T22:51:00.866ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.064427ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
57062024-11-07T22:51:01.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ca0bf988-05a8-4dad-82d6-22b6a9571604 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57072024-11-07T22:51:01.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ca0bf988-05a8-4dad-82d6-22b6a9571604 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57082024-11-07T22:51:01.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2004 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ca0bf988-05a8-4dad-82d6-22b6a9571604 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57092024-11-07T22:51:01.653ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1383 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = f3ec5d11-1a29-4a73-84e6-4e19ee521cfd response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
57102024-11-07T22:51:02.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 58c10a56-2c94-4a96-b48e-59841bd61763 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57112024-11-07T22:51:02.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 58c10a56-2c94-4a96-b48e-59841bd61763 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57122024-11-07T22:51:02.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1820 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 58c10a56-2c94-4a96-b48e-59841bd61763 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57132024-11-07T22:51:03.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 63a4d4e5-f8f7-40d9-9b12-ca3841fdf7ad roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57142024-11-07T22:51:03.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 63a4d4e5-f8f7-40d9-9b12-ca3841fdf7ad resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57152024-11-07T22:51:03.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 63a4d4e5-f8f7-40d9-9b12-ca3841fdf7ad response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57162024-11-07T22:51:04.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c033d7ac-2418-411c-a74e-dbdd1c0bb553 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57172024-11-07T22:51:04.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c033d7ac-2418-411c-a74e-dbdd1c0bb553 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57182024-11-07T22:51:04.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c033d7ac-2418-411c-a74e-dbdd1c0bb553 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57192024-11-07T22:51:04.221ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:52680
57202024-11-07T22:51:04.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52680 req_id = 7fe10e61-2a6e-4335-8a8a-2d5ffb1abf2c roles = RoleSet { roles: {} } uri = /metrics/producers
57212024-11-07T22:51:04.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52680 req_id = 7fe10e61-2a6e-4335-8a8a-2d5ffb1abf2c resource = Database result = Ok(()) uri = /metrics/producers
57222024-11-07T22:51:04.265ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = e777764e-54ab-4a09-9e71-5c47b8b59e5e
57232024-11-07T22:51:04.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43874 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52680 req_id = 7fe10e61-2a6e-4335-8a8a-2d5ffb1abf2c response_code = 201 uri = /metrics/producers
57242024-11-07T22:51:05.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c5da1616-5a34-4d4a-a6b6-429a52f8008b roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57252024-11-07T22:51:05.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c5da1616-5a34-4d4a-a6b6-429a52f8008b resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57262024-11-07T22:51:05.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1751 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c5da1616-5a34-4d4a-a6b6-429a52f8008b response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57272024-11-07T22:51:05.655ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:35593
57282024-11-07T22:51:05.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35593 req_id = b256e068-2957-4789-a0cb-713978fe8426 roles = RoleSet { roles: {} } uri = /metrics/producers
57292024-11-07T22:51:05.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35593 req_id = b256e068-2957-4789-a0cb-713978fe8426 resource = Database result = Ok(()) uri = /metrics/producers
57302024-11-07T22:51:05.696ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 5fb8d961-b437-4fc7-94a2-b09d338a9d9d
57312024-11-07T22:51:05.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40897 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35593 req_id = b256e068-2957-4789-a0cb-713978fe8426 response_code = 201 uri = /metrics/producers
57322024-11-07T22:51:06.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2b89fde3-5818-446f-88fe-a084333dca9e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57332024-11-07T22:51:06.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2b89fde3-5818-446f-88fe-a084333dca9e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57342024-11-07T22:51:06.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2b89fde3-5818-446f-88fe-a084333dca9e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57352024-11-07T22:51:07.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8f63080c-b7c0-476a-b0a0-53c38287acb8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57362024-11-07T22:51:07.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8f63080c-b7c0-476a-b0a0-53c38287acb8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57372024-11-07T22:51:07.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1664 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8f63080c-b7c0-476a-b0a0-53c38287acb8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57382024-11-07T22:51:08.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7c63b0a9-9add-4de4-a961-a8adbf88f614 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57392024-11-07T22:51:08.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7c63b0a9-9add-4de4-a961-a8adbf88f614 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57402024-11-07T22:51:08.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7c63b0a9-9add-4de4-a961-a8adbf88f614 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57412024-11-07T22:51:09.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8cbfc068-d6bb-4a21-9544-77b80ad78008 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57422024-11-07T22:51:09.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8cbfc068-d6bb-4a21-9544-77b80ad78008 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57432024-11-07T22:51:09.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2437 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8cbfc068-d6bb-4a21-9544-77b80ad78008 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57442024-11-07T22:51:10.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d872159c-39df-4dfd-a28c-3be48e985592 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57452024-11-07T22:51:10.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d872159c-39df-4dfd-a28c-3be48e985592 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57462024-11-07T22:51:10.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d872159c-39df-4dfd-a28c-3be48e985592 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57472024-11-07T22:51:10.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
57482024-11-07T22:51:10.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
57492024-11-07T22:51:10.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57502024-11-07T22:51:10.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57512024-11-07T22:51:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57522024-11-07T22:51:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57532024-11-07T22:51:10.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57542024-11-07T22:51:10.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57552024-11-07T22:51:10.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57562024-11-07T22:51:10.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.07609ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57572024-11-07T22:51:10.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57582024-11-07T22:51:10.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57592024-11-07T22:51:10.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57602024-11-07T22:51:10.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57612024-11-07T22:51:10.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57622024-11-07T22:51:10.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57632024-11-07T22:51:10.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
57642024-11-07T22:51:10.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57652024-11-07T22:51:10.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57662024-11-07T22:51:10.840ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
57672024-11-07T22:51:10.840ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.249381ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
57682024-11-07T22:51:11.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2ce00f34-8683-4d0a-a658-a5b75082100f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57692024-11-07T22:51:11.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2ce00f34-8683-4d0a-a658-a5b75082100f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57702024-11-07T22:51:11.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1916 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2ce00f34-8683-4d0a-a658-a5b75082100f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57712024-11-07T22:51:12.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 865dd3c3-b121-4b07-9896-8751873b4fc0 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57722024-11-07T22:51:12.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 865dd3c3-b121-4b07-9896-8751873b4fc0 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57732024-11-07T22:51:12.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2302 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 865dd3c3-b121-4b07-9896-8751873b4fc0 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57742024-11-07T22:51:13.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ebd48862-e660-4719-9885-23f2825ac8df roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57752024-11-07T22:51:13.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ebd48862-e660-4719-9885-23f2825ac8df resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57762024-11-07T22:51:13.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ebd48862-e660-4719-9885-23f2825ac8df response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57772024-11-07T22:51:14.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 931e4f86-cbfa-4024-bd2f-1b6cbd83f4e2 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57782024-11-07T22:51:14.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 931e4f86-cbfa-4024-bd2f-1b6cbd83f4e2 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57792024-11-07T22:51:14.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 931e4f86-cbfa-4024-bd2f-1b6cbd83f4e2 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57802024-11-07T22:51:15.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 832b8753-a562-44b9-9dfe-24e16603badd roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57812024-11-07T22:51:15.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 832b8753-a562-44b9-9dfe-24e16603badd resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57822024-11-07T22:51:15.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1849 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 832b8753-a562-44b9-9dfe-24e16603badd response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57832024-11-07T22:51:16.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e74c5687-3f6c-44ff-afd7-9fe61229ba50 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57842024-11-07T22:51:16.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e74c5687-3f6c-44ff-afd7-9fe61229ba50 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57852024-11-07T22:51:16.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1864 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e74c5687-3f6c-44ff-afd7-9fe61229ba50 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57862024-11-07T22:51:16.654ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1806 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 97491985-a34d-4ae1-9f52-5d86864baa2b response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
57872024-11-07T22:51:17.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 00112d25-d362-4cfd-b441-92e9e6ccfaf5 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57882024-11-07T22:51:17.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 00112d25-d362-4cfd-b441-92e9e6ccfaf5 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57892024-11-07T22:51:17.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 00112d25-d362-4cfd-b441-92e9e6ccfaf5 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57902024-11-07T22:51:18.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 18d34b9e-8f1e-4d78-8f44-1f565c19033b roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57912024-11-07T22:51:18.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 18d34b9e-8f1e-4d78-8f44-1f565c19033b resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57922024-11-07T22:51:18.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 18d34b9e-8f1e-4d78-8f44-1f565c19033b response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57932024-11-07T22:51:19.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 92cd1408-a335-45f7-adaf-0a06eb37bc36 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57942024-11-07T22:51:19.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 92cd1408-a335-45f7-adaf-0a06eb37bc36 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57952024-11-07T22:51:19.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 92cd1408-a335-45f7-adaf-0a06eb37bc36 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57962024-11-07T22:51:20.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 72cf7ac5-6272-488b-a37b-bad004eeecb5 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57972024-11-07T22:51:20.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 72cf7ac5-6272-488b-a37b-bad004eeecb5 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57982024-11-07T22:51:20.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 72cf7ac5-6272-488b-a37b-bad004eeecb5 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
57992024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
58002024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
58012024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58022024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58032024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
58042024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58052024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58062024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
58072024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
58082024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58092024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
58102024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58112024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58122024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
58132024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58142024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
58152024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58162024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
58172024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
58182024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
58192024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
58202024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58212024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
58222024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
58232024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
58242024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
58252024-11-07T22:51:20.818ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
58262024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58272024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58282024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
58292024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
58302024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58312024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58322024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
58332024-11-07T22:51:20.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58342024-11-07T22:51:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58352024-11-07T22:51:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58362024-11-07T22:51:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58372024-11-07T22:51:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58382024-11-07T22:51:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58392024-11-07T22:51:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58402024-11-07T22:51:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58412024-11-07T22:51:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58422024-11-07T22:51:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58432024-11-07T22:51:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58442024-11-07T22:51:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58452024-11-07T22:51:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58462024-11-07T22:51:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58472024-11-07T22:51:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58482024-11-07T22:51:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58492024-11-07T22:51:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58502024-11-07T22:51:20.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58512024-11-07T22:51:20.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58522024-11-07T22:51:20.822ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.949006ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58532024-11-07T22:51:20.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58542024-11-07T22:51:20.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58552024-11-07T22:51:20.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58562024-11-07T22:51:20.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58572024-11-07T22:51:20.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58582024-11-07T22:51:20.823ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58592024-11-07T22:51:20.824ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
58602024-11-07T22:51:20.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58612024-11-07T22:51:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58622024-11-07T22:51:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58632024-11-07T22:51:20.826ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1174, tv_nsec: 915713245 } })
58642024-11-07T22:51:20.826ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
58652024-11-07T22:51:20.830ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58662024-11-07T22:51:20.830ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58672024-11-07T22:51:20.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58682024-11-07T22:51:20.830ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1174, tv_nsec: 919706893 } })
58692024-11-07T22:51:20.830ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
58702024-11-07T22:51:20.832ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58712024-11-07T22:51:20.832ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58722024-11-07T22:51:20.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58732024-11-07T22:51:20.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58742024-11-07T22:51:20.833ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58752024-11-07T22:51:20.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58762024-11-07T22:51:20.834ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1174, tv_nsec: 923950147 } })
58772024-11-07T22:51:20.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58782024-11-07T22:51:20.835ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
58792024-11-07T22:51:20.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58802024-11-07T22:51:20.835ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58812024-11-07T22:51:20.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58822024-11-07T22:51:20.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58832024-11-07T22:51:20.836ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58842024-11-07T22:51:20.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58852024-11-07T22:51:20.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58862024-11-07T22:51:20.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58872024-11-07T22:51:20.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58882024-11-07T22:51:20.840ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58892024-11-07T22:51:20.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58902024-11-07T22:51:20.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
58912024-11-07T22:51:20.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58922024-11-07T22:51:20.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58932024-11-07T22:51:20.842ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58942024-11-07T22:51:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58952024-11-07T22:51:20.844ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58962024-11-07T22:51:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58972024-11-07T22:51:20.856ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
58982024-11-07T22:51:20.856ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.028556ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
58992024-11-07T22:51:20.858ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59002024-11-07T22:51:20.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 39.707251ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
59012024-11-07T22:51:20.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59022024-11-07T22:51:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59032024-11-07T22:51:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59042024-11-07T22:51:20.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59052024-11-07T22:51:20.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59062024-11-07T22:51:20.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59072024-11-07T22:51:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59082024-11-07T22:51:20.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 48.746475ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
59092024-11-07T22:51:20.867ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59102024-11-07T22:51:20.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59112024-11-07T22:51:20.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59122024-11-07T22:51:20.872ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59132024-11-07T22:51:20.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
59142024-11-07T22:51:20.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59152024-11-07T22:51:20.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59162024-11-07T22:51:20.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
59172024-11-07T22:51:20.876ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59182024-11-07T22:51:20.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59192024-11-07T22:51:20.880ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59202024-11-07T22:51:20.880ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
59212024-11-07T22:51:20.880ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59222024-11-07T22:51:20.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59232024-11-07T22:51:20.887ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 69.047813ms iteration = 18 status = 0
59242024-11-07T22:51:20.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.411122ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
59252024-11-07T22:51:20.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59262024-11-07T22:51:20.906ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59272024-11-07T22:51:20.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59282024-11-07T22:51:20.907ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59292024-11-07T22:51:20.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59302024-11-07T22:51:20.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59312024-11-07T22:51:20.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 95.833746ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59322024-11-07T22:51:20.916ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
59332024-11-07T22:51:20.916ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59342024-11-07T22:51:20.917ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a33f0425-6249-4047-b74d-b81d1fc4033f", "content-length": "26", "date": "Thu, 07 Nov 2024 22:51:20 GMT"} })
59352024-11-07T22:51:20.917ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59362024-11-07T22:51:20.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 100.241145ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59372024-11-07T22:51:20.919ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
59382024-11-07T22:51:20.928ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
59392024-11-07T22:51:20.928ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59402024-11-07T22:51:20.928ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "37534d6a-d089-43c9-baa3-7c9bd3d6a9b9", "content-length": "26", "date": "Thu, 07 Nov 2024 22:51:20 GMT"} })
59412024-11-07T22:51:20.928ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59422024-11-07T22:51:20.931ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59432024-11-07T22:51:20.936ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
59442024-11-07T22:51:20.936ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59452024-11-07T22:51:20.936ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "84e6a027-85e5-487d-b23c-2895499d7f9e", "content-length": "26", "date": "Thu, 07 Nov 2024 22:51:20 GMT"} })
59462024-11-07T22:51:20.936ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59472024-11-07T22:51:20.936ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59482024-11-07T22:51:20.936ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
59492024-11-07T22:51:20.936ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 118.2011ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
59502024-11-07T22:51:20.938ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59512024-11-07T22:51:20.946ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
59522024-11-07T22:51:20.946ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 127.750417ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
59532024-11-07T22:51:20.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 128.95755ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
59542024-11-07T22:51:20.957ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59552024-11-07T22:51:20.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59562024-11-07T22:51:20.986ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 167.701886ms iteration = 21 status = {"physical_disks_added":0}
59572024-11-07T22:51:21.060ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
59582024-11-07T22:51:21.060ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5cd4728-4aff-49a7-b318-e8b24702bd86", "content-length": "1", "date": "Thu, 07 Nov 2024 22:51:20 GMT"} })
59592024-11-07T22:51:21.062ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59602024-11-07T22:51:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59612024-11-07T22:51:21.084ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59622024-11-07T22:51:21.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59632024-11-07T22:51:21.123ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
59642024-11-07T22:51:21.123ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59652024-11-07T22:51:21.123ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d9edbc0-a9f5-4b0d-8d32-cdb6c7179e35", "content-length": "372", "date": "Thu, 07 Nov 2024 22:51:21 GMT"} })
59662024-11-07T22:51:21.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59672024-11-07T22:51:21.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59682024-11-07T22:51:21.125ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 306.582053ms iteration = 18 status = null
59692024-11-07T22:51:21.125ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59702024-11-07T22:51:21.127ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59712024-11-07T22:51:21.127ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59722024-11-07T22:51:21.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59732024-11-07T22:51:21.129ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59742024-11-07T22:51:21.131ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59752024-11-07T22:51:21.131ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59762024-11-07T22:51:21.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59772024-11-07T22:51:21.143ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
59782024-11-07T22:51:21.143ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
59792024-11-07T22:51:21.144ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7883dd72-41ae-44ca-aef5-a0db1d966a9f", "date": "Thu, 07 Nov 2024 22:51:21 GMT"} })
59802024-11-07T22:51:21.144ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59812024-11-07T22:51:21.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59822024-11-07T22:51:21.146ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59832024-11-07T22:51:21.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59842024-11-07T22:51:21.149ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59852024-11-07T22:51:21.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59862024-11-07T22:51:21.152ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 333.797658ms iteration = 18 status = {}
59872024-11-07T22:51:21.153ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
59882024-11-07T22:51:21.153ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59892024-11-07T22:51:21.153ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cbbfee0a-54a2-4bc1-8d0e-1ba7a739f0ac", "date": "Thu, 07 Nov 2024 22:51:21 GMT"} })
59902024-11-07T22:51:21.154ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 336.163391ms iteration = 19 status = {}
59912024-11-07T22:51:21.203ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59922024-11-07T22:51:21.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59932024-11-07T22:51:21.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59942024-11-07T22:51:21.232ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
59952024-11-07T22:51:21.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59962024-11-07T22:51:21.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59972024-11-07T22:51:21.242ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
59982024-11-07T22:51:21.243ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2536a254-6037-4be4-b549-7ebdcfc37268", "content-length": "134", "date": "Thu, 07 Nov 2024 22:51:21 GMT"} })
59992024-11-07T22:51:21.243ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
60002024-11-07T22:51:21.243ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
60012024-11-07T22:51:21.243ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
60022024-11-07T22:51:21.243ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60032024-11-07T22:51:21.243ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60042024-11-07T22:51:21.243ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60052024-11-07T22:51:21.243ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60062024-11-07T22:51:21.243ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60072024-11-07T22:51:21.243ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60082024-11-07T22:51:21.243ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60092024-11-07T22:51:21.243ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
60102024-11-07T22:51:21.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60112024-11-07T22:51:21.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60122024-11-07T22:51:21.246ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60132024-11-07T22:51:21.246ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c875f86b-e229-4326-a81d-d019269ae73e", "content-length": "2", "date": "Thu, 07 Nov 2024 22:51:21 GMT"} })
60142024-11-07T22:51:21.246ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60152024-11-07T22:51:21.246ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d3dcb0e-b488-4125-8309-68d77cfe2277", "content-length": "52", "date": "Thu, 07 Nov 2024 22:51:21 GMT"} })
60162024-11-07T22:51:21.246ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
60172024-11-07T22:51:21.246ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60182024-11-07T22:51:21.288ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3211619d-8d61-4081-95bc-6b8fe3f4b812", "content-length": "691", "date": "Thu, 07 Nov 2024 22:51:21 GMT"} })
60192024-11-07T22:51:21.288ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
60202024-11-07T22:51:21.288ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
60212024-11-07T22:51:21.288ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
60222024-11-07T22:51:21.289ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 470.915437ms iteration = 18 status = {}
60232024-11-07T22:51:21.391ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ea3d5f4f-607d-4cfb-a23a-b2c1087d2096", "date": "Thu, 07 Nov 2024 22:51:21 GMT"} })
60242024-11-07T22:51:21.391ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
60252024-11-07T22:51:21.391ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60262024-11-07T22:51:21.395ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6af208a8-9546-4680-a352-1d6bd53efb14", "content-length": "682", "date": "Thu, 07 Nov 2024 22:51:21 GMT"} })
60272024-11-07T22:51:21.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60282024-11-07T22:51:21.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60292024-11-07T22:51:21.399ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60302024-11-07T22:51:21.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60312024-11-07T22:51:21.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60322024-11-07T22:51:21.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60332024-11-07T22:51:21.405ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60342024-11-07T22:51:21.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60352024-11-07T22:51:21.412ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 594.245625ms iteration = 18 status = {}
60362024-11-07T22:51:21.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 768ac8f7-af91-4c8f-b4a2-5b6c30675c64 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60372024-11-07T22:51:21.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 768ac8f7-af91-4c8f-b4a2-5b6c30675c64 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60382024-11-07T22:51:21.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 768ac8f7-af91-4c8f-b4a2-5b6c30675c64 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60392024-11-07T22:51:21.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = bb91aa90-b018-4419-8ae7-09f6fdf2c524 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
60402024-11-07T22:51:21.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = bb91aa90-b018-4419-8ae7-09f6fdf2c524 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
60412024-11-07T22:51:21.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = bb91aa90-b018-4419-8ae7-09f6fdf2c524 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
60422024-11-07T22:51:21.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = eb73d90f-bed9-4384-8dbd-597478e2663e roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
60432024-11-07T22:51:21.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = eb73d90f-bed9-4384-8dbd-597478e2663e resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
60442024-11-07T22:51:21.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = eb73d90f-bed9-4384-8dbd-597478e2663e response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
60452024-11-07T22:51:21.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = cfcfcc5f-b5f2-4417-bc73-637764bd4a0d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
60462024-11-07T22:51:21.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = cfcfcc5f-b5f2-4417-bc73-637764bd4a0d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
60472024-11-07T22:51:21.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = cfcfcc5f-b5f2-4417-bc73-637764bd4a0d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
60482024-11-07T22:51:22.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3ced83cf-7b0a-4cc8-a93e-8a01eb1b9110 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60492024-11-07T22:51:22.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3ced83cf-7b0a-4cc8-a93e-8a01eb1b9110 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60502024-11-07T22:51:22.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3ced83cf-7b0a-4cc8-a93e-8a01eb1b9110 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60512024-11-07T22:51:23.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6b5f79a7-fafe-40b9-9f64-342b54f2109d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60522024-11-07T22:51:23.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6b5f79a7-fafe-40b9-9f64-342b54f2109d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60532024-11-07T22:51:23.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6b5f79a7-fafe-40b9-9f64-342b54f2109d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60542024-11-07T22:51:24.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 87eb3a90-f041-4888-941b-46dce2c2926f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60552024-11-07T22:51:24.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 87eb3a90-f041-4888-941b-46dce2c2926f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60562024-11-07T22:51:24.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 87eb3a90-f041-4888-941b-46dce2c2926f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60572024-11-07T22:51:25.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 681f9d30-e784-4456-b4de-26787280ef84 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60582024-11-07T22:51:25.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 681f9d30-e784-4456-b4de-26787280ef84 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60592024-11-07T22:51:25.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1899 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 681f9d30-e784-4456-b4de-26787280ef84 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60602024-11-07T22:51:26.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8a748104-970d-445c-b392-4ff45c1a202b roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60612024-11-07T22:51:26.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8a748104-970d-445c-b392-4ff45c1a202b resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60622024-11-07T22:51:26.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8a748104-970d-445c-b392-4ff45c1a202b response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60632024-11-07T22:51:27.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 165301c1-8729-4e25-9633-7ecc7ba3e5ef roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60642024-11-07T22:51:27.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 165301c1-8729-4e25-9633-7ecc7ba3e5ef resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60652024-11-07T22:51:27.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 165301c1-8729-4e25-9633-7ecc7ba3e5ef response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60662024-11-07T22:51:28.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 38ca5c13-bd50-4f3c-8d15-153b219b1a14 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60672024-11-07T22:51:28.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 38ca5c13-bd50-4f3c-8d15-153b219b1a14 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60682024-11-07T22:51:28.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 38ca5c13-bd50-4f3c-8d15-153b219b1a14 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60692024-11-07T22:51:29.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 09cc318d-e961-4d5c-873c-a44ece3737bc roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60702024-11-07T22:51:29.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 09cc318d-e961-4d5c-873c-a44ece3737bc resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60712024-11-07T22:51:29.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 09cc318d-e961-4d5c-873c-a44ece3737bc response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60722024-11-07T22:51:30.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 45e4ab4d-94b1-480f-8be4-af76e8952a82 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60732024-11-07T22:51:30.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 45e4ab4d-94b1-480f-8be4-af76e8952a82 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60742024-11-07T22:51:30.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 45e4ab4d-94b1-480f-8be4-af76e8952a82 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60752024-11-07T22:51:30.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
60762024-11-07T22:51:30.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
60772024-11-07T22:51:30.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60782024-11-07T22:51:30.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60792024-11-07T22:51:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60802024-11-07T22:51:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60812024-11-07T22:51:30.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60822024-11-07T22:51:30.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60832024-11-07T22:51:30.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60842024-11-07T22:51:30.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.781912ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60852024-11-07T22:51:30.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60862024-11-07T22:51:30.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60872024-11-07T22:51:30.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60882024-11-07T22:51:30.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60892024-11-07T22:51:30.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60902024-11-07T22:51:30.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60912024-11-07T22:51:30.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
60922024-11-07T22:51:30.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60932024-11-07T22:51:30.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60942024-11-07T22:51:30.837ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
60952024-11-07T22:51:30.837ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.005053ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
60962024-11-07T22:51:31.653ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1687 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = dcde611a-e293-412b-ad19-9bfd307474d0 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
60972024-11-07T22:51:31.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 97d01bd7-f6ba-47f6-8e98-30e75aed70fb roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60982024-11-07T22:51:31.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 97d01bd7-f6ba-47f6-8e98-30e75aed70fb resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
60992024-11-07T22:51:31.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1961 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 97d01bd7-f6ba-47f6-8e98-30e75aed70fb response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61002024-11-07T22:51:32.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b873fb4e-1792-4fb5-9a2b-eab4b282999f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61012024-11-07T22:51:32.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b873fb4e-1792-4fb5-9a2b-eab4b282999f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61022024-11-07T22:51:32.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2265 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b873fb4e-1792-4fb5-9a2b-eab4b282999f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61032024-11-07T22:51:33.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d0124cf3-4a4a-4f2e-9244-975bcb2ff077 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61042024-11-07T22:51:33.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d0124cf3-4a4a-4f2e-9244-975bcb2ff077 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61052024-11-07T22:51:33.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d0124cf3-4a4a-4f2e-9244-975bcb2ff077 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61062024-11-07T22:51:34.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 808fcd4d-8a70-4f85-a8de-2ddfc6712699 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61072024-11-07T22:51:34.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 808fcd4d-8a70-4f85-a8de-2ddfc6712699 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61082024-11-07T22:51:34.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1938 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 808fcd4d-8a70-4f85-a8de-2ddfc6712699 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61092024-11-07T22:51:35.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 72dea4de-d404-419a-be70-b728d48248ff roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61102024-11-07T22:51:35.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 72dea4de-d404-419a-be70-b728d48248ff resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61112024-11-07T22:51:35.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2682 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 72dea4de-d404-419a-be70-b728d48248ff response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61122024-11-07T22:51:36.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a5c40a5e-8a7b-4a8b-86aa-74dd21ed43b9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61132024-11-07T22:51:36.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a5c40a5e-8a7b-4a8b-86aa-74dd21ed43b9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61142024-11-07T22:51:36.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a5c40a5e-8a7b-4a8b-86aa-74dd21ed43b9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61152024-11-07T22:51:37.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2c01d08e-47c1-49d6-8be4-d0d7104e2ea6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61162024-11-07T22:51:37.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2c01d08e-47c1-49d6-8be4-d0d7104e2ea6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61172024-11-07T22:51:37.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2c01d08e-47c1-49d6-8be4-d0d7104e2ea6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61182024-11-07T22:51:38.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c74a1cfb-950a-422c-b725-4db3e8229496 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61192024-11-07T22:51:38.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c74a1cfb-950a-422c-b725-4db3e8229496 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61202024-11-07T22:51:38.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c74a1cfb-950a-422c-b725-4db3e8229496 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61212024-11-07T22:51:39.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6daccdb2-d5c3-4162-a548-ce14f33f29f7 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61222024-11-07T22:51:39.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6daccdb2-d5c3-4162-a548-ce14f33f29f7 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61232024-11-07T22:51:39.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6daccdb2-d5c3-4162-a548-ce14f33f29f7 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61242024-11-07T22:51:40.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
61252024-11-07T22:51:40.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
61262024-11-07T22:51:40.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61272024-11-07T22:51:40.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61282024-11-07T22:51:40.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61292024-11-07T22:51:40.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61302024-11-07T22:51:40.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61312024-11-07T22:51:40.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61322024-11-07T22:51:40.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61332024-11-07T22:51:40.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.201474ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61342024-11-07T22:51:40.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61352024-11-07T22:51:40.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61362024-11-07T22:51:40.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61372024-11-07T22:51:40.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61382024-11-07T22:51:40.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61392024-11-07T22:51:40.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61402024-11-07T22:51:40.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
61412024-11-07T22:51:40.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61422024-11-07T22:51:40.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61432024-11-07T22:51:40.836ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
61442024-11-07T22:51:40.836ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.975985ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
61452024-11-07T22:51:40.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d41bc89c-57fd-4f35-8fad-6a7f7db2ee61 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61462024-11-07T22:51:40.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d41bc89c-57fd-4f35-8fad-6a7f7db2ee61 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61472024-11-07T22:51:40.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d41bc89c-57fd-4f35-8fad-6a7f7db2ee61 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61482024-11-07T22:51:42.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 745fec43-d857-4c61-9419-1b21f48d0998 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61492024-11-07T22:51:42.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 745fec43-d857-4c61-9419-1b21f48d0998 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61502024-11-07T22:51:42.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 745fec43-d857-4c61-9419-1b21f48d0998 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61512024-11-07T22:51:43.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 188fc213-70bc-4e3c-bacf-3d97aea8e35e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61522024-11-07T22:51:43.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 188fc213-70bc-4e3c-bacf-3d97aea8e35e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61532024-11-07T22:51:43.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1892 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 188fc213-70bc-4e3c-bacf-3d97aea8e35e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61542024-11-07T22:51:44.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5dd9c5fe-a949-4b85-b872-9fb20c679914 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61552024-11-07T22:51:44.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5dd9c5fe-a949-4b85-b872-9fb20c679914 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61562024-11-07T22:51:44.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5dd9c5fe-a949-4b85-b872-9fb20c679914 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61572024-11-07T22:51:45.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f506db55-7583-4083-b106-4262275540a6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61582024-11-07T22:51:45.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f506db55-7583-4083-b106-4262275540a6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61592024-11-07T22:51:45.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f506db55-7583-4083-b106-4262275540a6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61602024-11-07T22:51:46.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d6894336-0079-4ad7-8137-fe8ecc8c4dd9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61612024-11-07T22:51:46.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d6894336-0079-4ad7-8137-fe8ecc8c4dd9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61622024-11-07T22:51:46.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d6894336-0079-4ad7-8137-fe8ecc8c4dd9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61632024-11-07T22:51:46.653ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1308 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 3f9b61bd-c2b7-4d20-b907-1bf0402a59d4 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
61642024-11-07T22:51:47.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e04e1241-f7b2-4186-a2f9-b910caf79990 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61652024-11-07T22:51:47.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e04e1241-f7b2-4186-a2f9-b910caf79990 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61662024-11-07T22:51:47.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2003 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e04e1241-f7b2-4186-a2f9-b910caf79990 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61672024-11-07T22:51:48.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6f5f49af-d577-4b59-ab82-13eb59b9de89 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61682024-11-07T22:51:48.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6f5f49af-d577-4b59-ab82-13eb59b9de89 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61692024-11-07T22:51:48.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6f5f49af-d577-4b59-ab82-13eb59b9de89 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61702024-11-07T22:51:49.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 23f8700d-ff50-4a7d-8d6f-b78cfa074f4d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61712024-11-07T22:51:49.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 23f8700d-ff50-4a7d-8d6f-b78cfa074f4d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61722024-11-07T22:51:49.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 23f8700d-ff50-4a7d-8d6f-b78cfa074f4d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61732024-11-07T22:51:50.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3d801646-5502-4b86-aafd-f18436c87f1c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61742024-11-07T22:51:50.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3d801646-5502-4b86-aafd-f18436c87f1c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61752024-11-07T22:51:50.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3d801646-5502-4b86-aafd-f18436c87f1c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
61762024-11-07T22:51:50.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
61772024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
61782024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
61792024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61802024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61812024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61822024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61832024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
61842024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61852024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
61862024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
61872024-11-07T22:51:50.819ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-07 22:41:50.819031920 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
61882024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
61892024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
61902024-11-07T22:51:50.819ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531
61912024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.92\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531"}
61922024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
61932024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
61942024-11-07T22:51:50.819ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
61952024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
61962024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61972024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
61982024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61992024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62002024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
62012024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
62022024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
62032024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62042024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62052024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
62062024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62072024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
62082024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
62092024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
62102024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
62112024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62122024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
62132024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
62142024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62152024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62162024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
62172024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
62182024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62192024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
62202024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
62212024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62222024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
62232024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
62242024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
62252024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62262024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
62272024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62282024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
62292024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
62302024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62312024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
62322024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
62332024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
62342024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
62352024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
62362024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62372024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
62382024-11-07T22:51:50.819ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
62392024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62402024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62412024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62422024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62432024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
62442024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62452024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62462024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62472024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62482024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62492024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62502024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62512024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
62522024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62532024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62542024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62552024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62562024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62572024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62582024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62592024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62602024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62612024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62622024-11-07T22:51:50.819ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19da6a5b-073a-4e12-8775-91fc61c1e962.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1204, tv_nsec: 909134597 } })
62632024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62642024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62652024-11-07T22:51:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
62662024-11-07T22:51:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
62672024-11-07T22:51:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62682024-11-07T22:51:50.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62692024-11-07T22:51:50.820ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a127151b-10b2-4835-91ce-b493ecd30481.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("de9282a1-0aa7-4ad8-a39a-58f19d05b651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1204, tv_nsec: 909278061 } })
62702024-11-07T22:51:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62712024-11-07T22:51:50.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62722024-11-07T22:51:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
62732024-11-07T22:51:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.055298ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
62742024-11-07T22:51:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62752024-11-07T22:51:50.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62762024-11-07T22:51:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62772024-11-07T22:51:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
62782024-11-07T22:51:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.254204ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
62792024-11-07T22:51:50.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62802024-11-07T22:51:50.822ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1204, tv_nsec: 911272975 } })
62812024-11-07T22:51:50.822ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
62822024-11-07T22:51:50.822ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-07 22:41:50.819031920 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
62832024-11-07T22:51:50.822ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.691379ms iteration = 10 status = {"expiration":"2024-11-07T22:41:50.819031920Z","pruned":[]}
62842024-11-07T22:51:50.822ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.816983ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62852024-11-07T22:51:50.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62862024-11-07T22:51:50.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62872024-11-07T22:51:50.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62882024-11-07T22:51:50.826ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62892024-11-07T22:51:50.826ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62902024-11-07T22:51:50.826ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62912024-11-07T22:51:50.827ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62922024-11-07T22:51:50.827ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62932024-11-07T22:51:50.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62942024-11-07T22:51:50.829ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62952024-11-07T22:51:50.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62962024-11-07T22:51:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
62972024-11-07T22:51:50.830ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
62982024-11-07T22:51:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62992024-11-07T22:51:50.830ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63002024-11-07T22:51:50.830ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
63012024-11-07T22:51:50.830ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63022024-11-07T22:51:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
63032024-11-07T22:51:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63042024-11-07T22:51:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63052024-11-07T22:51:50.831ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63062024-11-07T22:51:50.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63072024-11-07T22:51:50.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
63082024-11-07T22:51:50.831ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63092024-11-07T22:51:50.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63102024-11-07T22:51:50.832ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63112024-11-07T22:51:50.832ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63122024-11-07T22:51:50.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63132024-11-07T22:51:50.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.989658ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
63142024-11-07T22:51:50.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63152024-11-07T22:51:50.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63162024-11-07T22:51:50.834ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1204, tv_nsec: 923376191 } })
63172024-11-07T22:51:50.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
63182024-11-07T22:51:50.834ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63192024-11-07T22:51:50.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63202024-11-07T22:51:50.834ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
63212024-11-07T22:51:50.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.747582ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
63222024-11-07T22:51:50.836ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63232024-11-07T22:51:50.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63242024-11-07T22:51:50.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
63252024-11-07T22:51:50.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63262024-11-07T22:51:50.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63272024-11-07T22:51:50.839ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63282024-11-07T22:51:50.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63292024-11-07T22:51:50.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63302024-11-07T22:51:50.841ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.342153ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
63312024-11-07T22:51:50.841ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63322024-11-07T22:51:50.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63332024-11-07T22:51:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
63342024-11-07T22:51:50.843ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63352024-11-07T22:51:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63362024-11-07T22:51:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63372024-11-07T22:51:50.843ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63382024-11-07T22:51:50.844ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63392024-11-07T22:51:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63402024-11-07T22:51:50.845ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1204, tv_nsec: 934534463 } })
63412024-11-07T22:51:50.845ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
63422024-11-07T22:51:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
63432024-11-07T22:51:50.845ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63442024-11-07T22:51:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63452024-11-07T22:51:50.845ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63462024-11-07T22:51:50.847ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63472024-11-07T22:51:50.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
63482024-11-07T22:51:50.848ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63492024-11-07T22:51:50.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63502024-11-07T22:51:50.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63512024-11-07T22:51:50.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63522024-11-07T22:51:50.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63532024-11-07T22:51:50.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.231532ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63542024-11-07T22:51:50.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63552024-11-07T22:51:50.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63562024-11-07T22:51:50.854ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63572024-11-07T22:51:50.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63582024-11-07T22:51:50.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63592024-11-07T22:51:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63602024-11-07T22:51:50.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63612024-11-07T22:51:50.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63622024-11-07T22:51:50.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63632024-11-07T22:51:50.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63642024-11-07T22:51:50.865ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63652024-11-07T22:51:50.865ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
63662024-11-07T22:51:50.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63672024-11-07T22:51:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63682024-11-07T22:51:50.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63692024-11-07T22:51:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
63702024-11-07T22:51:50.865ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63712024-11-07T22:51:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63722024-11-07T22:51:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63732024-11-07T22:51:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63742024-11-07T22:51:50.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 50.308998ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
63752024-11-07T22:51:50.872ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63762024-11-07T22:51:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63772024-11-07T22:51:50.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63782024-11-07T22:51:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63792024-11-07T22:51:50.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63802024-11-07T22:51:50.874ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63812024-11-07T22:51:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63822024-11-07T22:51:50.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.991038ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63832024-11-07T22:51:50.878ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
63842024-11-07T22:51:50.878ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63852024-11-07T22:51:50.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63862024-11-07T22:51:50.882ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63872024-11-07T22:51:50.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63882024-11-07T22:51:50.887ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
63892024-11-07T22:51:50.887ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
63902024-11-07T22:51:50.887ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 68.057016ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
63912024-11-07T22:51:50.890ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63922024-11-07T22:51:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63932024-11-07T22:51:50.899ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63942024-11-07T22:51:50.899ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
63952024-11-07T22:51:50.899ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
63962024-11-07T22:51:50.899ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 80.557394ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
63972024-11-07T22:51:50.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
63982024-11-07T22:51:50.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63992024-11-07T22:51:50.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64002024-11-07T22:51:50.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64012024-11-07T22:51:50.903ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 84.647534ms iteration = 5 status = {"nsuccess":5}
64022024-11-07T22:51:50.906ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
64032024-11-07T22:51:50.906ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.010118ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
64042024-11-07T22:51:50.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
64052024-11-07T22:51:50.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64062024-11-07T22:51:50.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64072024-11-07T22:51:50.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64082024-11-07T22:51:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64092024-11-07T22:51:50.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64102024-11-07T22:51:50.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64112024-11-07T22:51:50.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64122024-11-07T22:51:50.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
64132024-11-07T22:51:50.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64142024-11-07T22:51:50.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64152024-11-07T22:51:50.917ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.694233ms iteration = 19 status = 0
64162024-11-07T22:51:50.918ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64172024-11-07T22:51:50.918ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
64182024-11-07T22:51:50.918ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64192024-11-07T22:51:50.918ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
64202024-11-07T22:51:50.918ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 99.384432ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
64212024-11-07T22:51:50.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64222024-11-07T22:51:50.920ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
64232024-11-07T22:51:50.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
64242024-11-07T22:51:50.921ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
64252024-11-07T22:51:50.921ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
64262024-11-07T22:51:50.921ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
64272024-11-07T22:51:50.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64282024-11-07T22:51:50.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64292024-11-07T22:51:50.923ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 104.165531ms iteration = 22 status = {"physical_disks_added":0}
64302024-11-07T22:51:50.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64312024-11-07T22:51:50.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64322024-11-07T22:51:50.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64332024-11-07T22:51:50.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64342024-11-07T22:51:50.927ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 108.528529ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
64352024-11-07T22:51:50.943ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-07T22:42:48.907310Z, time_modified: 2024-11-07T22:42:48.907310Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }) }
64362024-11-07T22:51:50.943ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 124.336945ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]}},"default_endpoint":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
64372024-11-07T22:51:50.943ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
64382024-11-07T22:51:50.943ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
64392024-11-07T22:51:50.943ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
64402024-11-07T22:51:50.943ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64412024-11-07T22:51:50.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64422024-11-07T22:51:50.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64432024-11-07T22:51:50.954ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64442024-11-07T22:51:50.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64452024-11-07T22:51:50.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64462024-11-07T22:51:50.965ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
64472024-11-07T22:51:50.978ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
64482024-11-07T22:51:50.978ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64492024-11-07T22:51:50.979ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6dd15c24-e3bf-4c2c-80d3-b1e4ad917f07", "content-length": "26", "date": "Thu, 07 Nov 2024 22:51:50 GMT"} })
64502024-11-07T22:51:50.979ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64512024-11-07T22:51:50.979ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64522024-11-07T22:51:50.979ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
64532024-11-07T22:51:50.979ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 160.539512ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
64542024-11-07T22:51:50.982ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64552024-11-07T22:51:51.017ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
64562024-11-07T22:51:51.017ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
64572024-11-07T22:51:51.017ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
64582024-11-07T22:51:51.017ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64592024-11-07T22:51:51.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64602024-11-07T22:51:51.020ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64612024-11-07T22:51:51.021ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64622024-11-07T22:51:51.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64632024-11-07T22:51:51.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64642024-11-07T22:51:51.025ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64652024-11-07T22:51:51.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64662024-11-07T22:51:51.028ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
64672024-11-07T22:51:51.028ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 0 version = 2
64682024-11-07T22:51:51.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64692024-11-07T22:51:51.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64702024-11-07T22:51:51.034ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
64712024-11-07T22:51:51.034ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 215.526256ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
64722024-11-07T22:51:51.068ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
64732024-11-07T22:51:51.068ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64742024-11-07T22:51:51.068ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "76b2fd76-0f7a-4824-93ec-a866bd36d968", "content-length": "26", "date": "Thu, 07 Nov 2024 22:51:50 GMT"} })
64752024-11-07T22:51:51.068ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64762024-11-07T22:51:51.070ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
64772024-11-07T22:51:51.143ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
64782024-11-07T22:51:51.143ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64792024-11-07T22:51:51.143ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1a87e31-005a-4f5a-97d8-389d2d9746eb", "content-length": "372", "date": "Thu, 07 Nov 2024 22:51:51 GMT"} })
64802024-11-07T22:51:51.143ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64812024-11-07T22:51:51.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64822024-11-07T22:51:51.146ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64832024-11-07T22:51:51.146ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
64842024-11-07T22:51:51.146ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
64852024-11-07T22:51:51.146ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-07 22:43:11.086261 UTC dns_group = internal generation = 1
64862024-11-07T22:51:51.146ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 327.22987ms iteration = 11 status = {"generation":1}
64872024-11-07T22:51:51.150ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64882024-11-07T22:51:51.150ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64892024-11-07T22:51:51.150ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64902024-11-07T22:51:51.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64912024-11-07T22:51:51.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64922024-11-07T22:51:51.152ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64932024-11-07T22:51:51.152ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 1 version = 2
64942024-11-07T22:51:51.152ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
64952024-11-07T22:51:51.152ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-07 22:43:11.643428 UTC dns_group = external generation = 2
64962024-11-07T22:51:51.152ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 333.726555ms iteration = 11 status = {"generation":2}
64972024-11-07T22:51:51.155ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64982024-11-07T22:51:51.155ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64992024-11-07T22:51:51.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65002024-11-07T22:51:51.157ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
65012024-11-07T22:51:51.157ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5e3e64e2-6a78-4d50-96ca-fbc5026c2150", "date": "Thu, 07 Nov 2024 22:51:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65022024-11-07T22:51:51.158ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65032024-11-07T22:51:51.160ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "bfaaed25-ca8f-4d93-8f61-9554221497b6", "date": "Thu, 07 Nov 2024 22:51:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65042024-11-07T22:51:51.160ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65052024-11-07T22:51:51.163ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65062024-11-07T22:51:51.163ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 344.091185ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
65072024-11-07T22:51:51.164ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
65082024-11-07T22:51:51.164ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65092024-11-07T22:51:51.164ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "89ea007d-9fc5-463d-b77c-54f2afbb4b4c", "content-length": "26", "date": "Thu, 07 Nov 2024 22:51:50 GMT"} })
65102024-11-07T22:51:51.164ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65112024-11-07T22:51:51.166ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65122024-11-07T22:51:51.188ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65132024-11-07T22:51:51.191ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
65142024-11-07T22:51:51.191ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
65152024-11-07T22:51:51.191ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "024f78b2-d5d8-4a48-b618-927df01fe1a6", "date": "Thu, 07 Nov 2024 22:51:51 GMT"} })
65162024-11-07T22:51:51.191ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65172024-11-07T22:51:51.191ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 372.742899ms iteration = 19 status = {}
65182024-11-07T22:51:51.191ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65192024-11-07T22:51:51.191ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65202024-11-07T22:51:51.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65212024-11-07T22:51:51.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65222024-11-07T22:51:51.194ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65232024-11-07T22:51:51.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65242024-11-07T22:51:51.197ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65252024-11-07T22:51:51.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65262024-11-07T22:51:51.201ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
65272024-11-07T22:51:51.201ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65282024-11-07T22:51:51.201ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1d2b2a36-ab4a-4daa-9399-a76b185561b9", "date": "Thu, 07 Nov 2024 22:51:51 GMT"} })
65292024-11-07T22:51:51.203ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 383.92597ms iteration = 20 status = {}
65302024-11-07T22:51:51.208ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
65312024-11-07T22:51:51.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 535de3dc-d853-4b32-bf65-c20300b1ad90 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
65322024-11-07T22:51:51.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 535de3dc-d853-4b32-bf65-c20300b1ad90 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
65332024-11-07T22:51:51.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 535de3dc-d853-4b32-bf65-c20300b1ad90 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
65342024-11-07T22:51:51.225ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
65352024-11-07T22:51:51.225ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fcfd207-59eb-413c-ae62-6da686921fb1", "content-length": "1", "date": "Thu, 07 Nov 2024 22:51:50 GMT"} })
65362024-11-07T22:51:51.226ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65372024-11-07T22:51:51.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65382024-11-07T22:51:51.228ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 409.259334ms iteration = 19 status = null
65392024-11-07T22:51:51.278ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
65402024-11-07T22:51:51.279ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7f3dcfbf-ab11-4d07-b3f6-75f6f83310eb", "date": "Thu, 07 Nov 2024 22:51:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65412024-11-07T22:51:51.279ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65422024-11-07T22:51:51.280ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7f5b63f7-63c5-49e6-a366-c0fa7174c00d", "date": "Thu, 07 Nov 2024 22:51:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65432024-11-07T22:51:51.280ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65442024-11-07T22:51:51.282ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "eeadaa43-f465-477a-9b2f-88878b2dca50", "date": "Thu, 07 Nov 2024 22:51:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65452024-11-07T22:51:51.282ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65462024-11-07T22:51:51.284ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
65472024-11-07T22:51:51.284ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 465.08039ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
65482024-11-07T22:51:51.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65492024-11-07T22:51:51.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65502024-11-07T22:51:51.338ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
65512024-11-07T22:51:51.338ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65522024-11-07T22:51:51.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65532024-11-07T22:51:51.342ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
65542024-11-07T22:51:51.342ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c0e9240-f718-43f5-a4fd-86e6b8766f76", "content-length": "691", "date": "Thu, 07 Nov 2024 22:51:51 GMT"} })
65552024-11-07T22:51:51.342ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
65562024-11-07T22:51:51.342ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
65572024-11-07T22:51:51.342ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
65582024-11-07T22:51:51.344ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 525.387458ms iteration = 19 status = {}
65592024-11-07T22:51:51.350ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
65602024-11-07T22:51:51.350ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "07f7827e-9035-4e21-b0c5-016fd7ca3c6f", "content-length": "134", "date": "Thu, 07 Nov 2024 22:51:51 GMT"} })
65612024-11-07T22:51:51.350ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
65622024-11-07T22:51:51.350ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
65632024-11-07T22:51:51.350ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
65642024-11-07T22:51:51.350ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
65652024-11-07T22:51:51.350ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65662024-11-07T22:51:51.350ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65672024-11-07T22:51:51.350ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65682024-11-07T22:51:51.350ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65692024-11-07T22:51:51.351ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65702024-11-07T22:51:51.351ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65712024-11-07T22:51:51.351ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
65722024-11-07T22:51:51.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65732024-11-07T22:51:51.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65742024-11-07T22:51:51.353ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
65752024-11-07T22:51:51.354ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4605130-6830-4e53-bf8a-c710e35eb555", "content-length": "2", "date": "Thu, 07 Nov 2024 22:51:51 GMT"} })
65762024-11-07T22:51:51.354ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
65772024-11-07T22:51:51.354ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b3c1858-171e-47d7-a8b2-f5aae7dec6ea", "content-length": "52", "date": "Thu, 07 Nov 2024 22:51:51 GMT"} })
65782024-11-07T22:51:51.354ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
65792024-11-07T22:51:51.354ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
65802024-11-07T22:51:51.460ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e3bf3f1b-fe90-4687-b811-9bf92ab4a83f", "date": "Thu, 07 Nov 2024 22:51:51 GMT"} })
65812024-11-07T22:51:51.460ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
65822024-11-07T22:51:51.460ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
65832024-11-07T22:51:51.460ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a994943-fb23-4fca-980c-d8fba5174793", "content-length": "682", "date": "Thu, 07 Nov 2024 22:51:51 GMT"} })
65842024-11-07T22:51:51.460ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65852024-11-07T22:51:51.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65862024-11-07T22:51:51.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65872024-11-07T22:51:51.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65882024-11-07T22:51:51.467ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65892024-11-07T22:51:51.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65902024-11-07T22:51:51.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65912024-11-07T22:51:51.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65922024-11-07T22:51:51.477ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 658.239492ms iteration = 19 status = {}
65932024-11-07T22:51:51.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = a818124d-26bd-4a04-8f48-8f54a8cc63f5 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
65942024-11-07T22:51:51.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = a818124d-26bd-4a04-8f48-8f54a8cc63f5 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
65952024-11-07T22:51:51.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = a818124d-26bd-4a04-8f48-8f54a8cc63f5 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
65962024-11-07T22:51:51.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 8858f412-ec99-43c4-927d-cd2dbd3b44ff roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
65972024-11-07T22:51:51.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 8858f412-ec99-43c4-927d-cd2dbd3b44ff resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
65982024-11-07T22:51:51.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2387 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 8858f412-ec99-43c4-927d-cd2dbd3b44ff response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
65992024-11-07T22:51:51.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 10b3bfdc-b315-4fb6-9539-b2619a634f56 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
66002024-11-07T22:51:51.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 10b3bfdc-b315-4fb6-9539-b2619a634f56 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
66012024-11-07T22:51:51.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 10b3bfdc-b315-4fb6-9539-b2619a634f56 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
66022024-11-07T22:51:52.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d5d65387-65e2-4a11-9778-00394922bcb4 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66032024-11-07T22:51:52.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d5d65387-65e2-4a11-9778-00394922bcb4 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66042024-11-07T22:51:52.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2062 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d5d65387-65e2-4a11-9778-00394922bcb4 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66052024-11-07T22:51:53.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1f33f4c5-2147-44d8-9a68-318bf0ec255b roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66062024-11-07T22:51:53.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1f33f4c5-2147-44d8-9a68-318bf0ec255b resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66072024-11-07T22:51:53.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1f33f4c5-2147-44d8-9a68-318bf0ec255b response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66082024-11-07T22:51:54.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 544ff7d0-b7b6-4703-b237-09505a065340 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66092024-11-07T22:51:54.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 544ff7d0-b7b6-4703-b237-09505a065340 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66102024-11-07T22:51:54.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2387 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 544ff7d0-b7b6-4703-b237-09505a065340 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66112024-11-07T22:51:55.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f91ef878-607d-46ff-92f8-0471bb42cd8c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66122024-11-07T22:51:55.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f91ef878-607d-46ff-92f8-0471bb42cd8c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66132024-11-07T22:51:55.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f91ef878-607d-46ff-92f8-0471bb42cd8c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66142024-11-07T22:51:56.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 45e1fa40-e5ea-4d15-a7ca-a4232be7aea1 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66152024-11-07T22:51:56.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 45e1fa40-e5ea-4d15-a7ca-a4232be7aea1 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66162024-11-07T22:51:56.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 45e1fa40-e5ea-4d15-a7ca-a4232be7aea1 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66172024-11-07T22:51:57.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 063a4e69-1a2d-494a-a0eb-c49431fd7348 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66182024-11-07T22:51:57.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 063a4e69-1a2d-494a-a0eb-c49431fd7348 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66192024-11-07T22:51:57.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 063a4e69-1a2d-494a-a0eb-c49431fd7348 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66202024-11-07T22:51:58.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 761a0a44-1daf-4031-bbf4-3a03a449bf30 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66212024-11-07T22:51:58.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 761a0a44-1daf-4031-bbf4-3a03a449bf30 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66222024-11-07T22:51:58.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 761a0a44-1daf-4031-bbf4-3a03a449bf30 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66232024-11-07T22:51:59.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2a11d2a2-633a-4f05-80d2-a1c2ff94a57a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66242024-11-07T22:51:59.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2a11d2a2-633a-4f05-80d2-a1c2ff94a57a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66252024-11-07T22:51:59.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2a11d2a2-633a-4f05-80d2-a1c2ff94a57a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66262024-11-07T22:52:00.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6b069075-634e-40b9-8c47-c314f0fcc95d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66272024-11-07T22:52:00.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6b069075-634e-40b9-8c47-c314f0fcc95d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66282024-11-07T22:52:00.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6b069075-634e-40b9-8c47-c314f0fcc95d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66292024-11-07T22:52:00.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
66302024-11-07T22:52:00.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66312024-11-07T22:52:00.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
66322024-11-07T22:52:00.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66332024-11-07T22:52:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66342024-11-07T22:52:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66352024-11-07T22:52:00.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66362024-11-07T22:52:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66372024-11-07T22:52:00.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66382024-11-07T22:52:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66392024-11-07T22:52:00.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66402024-11-07T22:52:00.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66412024-11-07T22:52:00.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66422024-11-07T22:52:00.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
66432024-11-07T22:52:00.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66442024-11-07T22:52:00.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66452024-11-07T22:52:00.838ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
66462024-11-07T22:52:00.838ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.116183ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
66472024-11-07T22:52:00.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66482024-11-07T22:52:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66492024-11-07T22:52:00.875ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.504445ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66502024-11-07T22:52:01.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 477eb651-b5c0-4fcc-a52f-ff85b3b1d014 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66512024-11-07T22:52:01.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 477eb651-b5c0-4fcc-a52f-ff85b3b1d014 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66522024-11-07T22:52:01.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 477eb651-b5c0-4fcc-a52f-ff85b3b1d014 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66532024-11-07T22:52:01.654ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1237 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = e815239a-e0c3-4005-87bd-521eca61aed6 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
66542024-11-07T22:52:02.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dda4edea-b4a1-4092-af14-d1e50c4260dd roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66552024-11-07T22:52:02.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dda4edea-b4a1-4092-af14-d1e50c4260dd resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66562024-11-07T22:52:02.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dda4edea-b4a1-4092-af14-d1e50c4260dd response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66572024-11-07T22:52:03.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 54534e32-b4a2-4f0e-b1c0-278930f30ef1 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66582024-11-07T22:52:03.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 54534e32-b4a2-4f0e-b1c0-278930f30ef1 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66592024-11-07T22:52:03.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2493 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 54534e32-b4a2-4f0e-b1c0-278930f30ef1 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66602024-11-07T22:52:04.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d845de9a-89fa-4f24-93aa-63eaaad1a220 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66612024-11-07T22:52:04.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d845de9a-89fa-4f24-93aa-63eaaad1a220 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66622024-11-07T22:52:04.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d845de9a-89fa-4f24-93aa-63eaaad1a220 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66632024-11-07T22:52:05.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 39719bb4-bd55-46c6-9a91-08212aa8254d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66642024-11-07T22:52:05.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 39719bb4-bd55-46c6-9a91-08212aa8254d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66652024-11-07T22:52:05.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1921 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 39719bb4-bd55-46c6-9a91-08212aa8254d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66662024-11-07T22:52:06.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f1012757-3eaa-4361-9d9a-7b75f47440b8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66672024-11-07T22:52:06.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f1012757-3eaa-4361-9d9a-7b75f47440b8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66682024-11-07T22:52:06.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2450 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f1012757-3eaa-4361-9d9a-7b75f47440b8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66692024-11-07T22:52:07.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f41d290f-07d9-4f71-9e97-ee23fb076a50 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66702024-11-07T22:52:07.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f41d290f-07d9-4f71-9e97-ee23fb076a50 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66712024-11-07T22:52:07.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f41d290f-07d9-4f71-9e97-ee23fb076a50 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66722024-11-07T22:52:08.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5d8323df-c5e8-4a63-a54c-0dbced01c40f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66732024-11-07T22:52:08.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5d8323df-c5e8-4a63-a54c-0dbced01c40f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66742024-11-07T22:52:08.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5d8323df-c5e8-4a63-a54c-0dbced01c40f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66752024-11-07T22:52:09.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 00bbb6ae-2edb-4000-bc91-6f595525491f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66762024-11-07T22:52:09.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 00bbb6ae-2edb-4000-bc91-6f595525491f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66772024-11-07T22:52:09.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 00bbb6ae-2edb-4000-bc91-6f595525491f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66782024-11-07T22:52:10.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 93f68cfd-5a2e-4611-9f04-5dd3433b166a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66792024-11-07T22:52:10.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 93f68cfd-5a2e-4611-9f04-5dd3433b166a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66802024-11-07T22:52:10.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 93f68cfd-5a2e-4611-9f04-5dd3433b166a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
66812024-11-07T22:52:10.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
66822024-11-07T22:52:10.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
66832024-11-07T22:52:10.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66842024-11-07T22:52:10.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66852024-11-07T22:52:10.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66862024-11-07T22:52:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66872024-11-07T22:52:10.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66882024-11-07T22:52:10.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66892024-11-07T22:52:10.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66902024-11-07T22:52:10.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66912024-11-07T22:52:10.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66922024-11-07T22:52:10.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66932024-11-07T22:52:10.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66942024-11-07T22:52:10.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66952024-11-07T22:52:10.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66962024-11-07T22:52:10.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
66972024-11-07T22:52:10.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66982024-11-07T22:52:10.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66992024-11-07T22:52:10.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
67002024-11-07T22:52:10.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.221974ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
67012024-11-07T22:52:10.880ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.995793ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67022024-11-07T22:52:11.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ae56889a-9da1-4a3e-a9b5-842995d8d40f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67032024-11-07T22:52:11.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ae56889a-9da1-4a3e-a9b5-842995d8d40f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67042024-11-07T22:52:11.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1794 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ae56889a-9da1-4a3e-a9b5-842995d8d40f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67052024-11-07T22:52:12.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 45be50bf-8a3a-4f30-8fc3-813bb31e8fd5 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67062024-11-07T22:52:12.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 45be50bf-8a3a-4f30-8fc3-813bb31e8fd5 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67072024-11-07T22:52:12.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 45be50bf-8a3a-4f30-8fc3-813bb31e8fd5 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67082024-11-07T22:52:13.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 43e9d954-7322-4cbc-8955-15ecf1bcf813 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67092024-11-07T22:52:13.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 43e9d954-7322-4cbc-8955-15ecf1bcf813 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67102024-11-07T22:52:13.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2491 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 43e9d954-7322-4cbc-8955-15ecf1bcf813 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67112024-11-07T22:52:14.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 26258bc7-8ed7-4cf3-bc70-5b6523ffad8a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67122024-11-07T22:52:14.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 26258bc7-8ed7-4cf3-bc70-5b6523ffad8a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67132024-11-07T22:52:14.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2004 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 26258bc7-8ed7-4cf3-bc70-5b6523ffad8a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67142024-11-07T22:52:15.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 72145a95-d940-48e0-a33c-641c26747ccb roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67152024-11-07T22:52:15.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 72145a95-d940-48e0-a33c-641c26747ccb resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67162024-11-07T22:52:15.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1815 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 72145a95-d940-48e0-a33c-641c26747ccb response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67172024-11-07T22:52:16.654ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1288 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = f54bbbb8-8eaa-4bb6-8881-0b3ec76377fd response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
67182024-11-07T22:52:16.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8bf9d23e-4a57-4e46-bf77-df1c528c08a8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67192024-11-07T22:52:16.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8bf9d23e-4a57-4e46-bf77-df1c528c08a8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67202024-11-07T22:52:16.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8bf9d23e-4a57-4e46-bf77-df1c528c08a8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67212024-11-07T22:52:17.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 50d89a54-d873-41c4-95b6-599af8d0553b roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67222024-11-07T22:52:17.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 50d89a54-d873-41c4-95b6-599af8d0553b resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67232024-11-07T22:52:17.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 50d89a54-d873-41c4-95b6-599af8d0553b response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67242024-11-07T22:52:18.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bd9f153f-070e-4a07-bb84-7b058aae584c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67252024-11-07T22:52:18.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bd9f153f-070e-4a07-bb84-7b058aae584c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67262024-11-07T22:52:18.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bd9f153f-070e-4a07-bb84-7b058aae584c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67272024-11-07T22:52:19.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7d5a6877-379c-4203-9629-0c3401776bf5 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67282024-11-07T22:52:19.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7d5a6877-379c-4203-9629-0c3401776bf5 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67292024-11-07T22:52:19.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7d5a6877-379c-4203-9629-0c3401776bf5 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
67302024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
67312024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
67322024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67332024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67342024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
67352024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
67362024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
67372024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
67382024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
67392024-11-07T22:52:20.818ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
67402024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67412024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
67422024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67432024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
67442024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67452024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
67462024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
67472024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
67482024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
67492024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67502024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67512024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
67522024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
67532024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67542024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67552024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
67562024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67572024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
67582024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
67592024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67602024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
67612024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
67622024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67632024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
67642024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67652024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67662024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67672024-11-07T22:52:20.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67682024-11-07T22:52:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67692024-11-07T22:52:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67702024-11-07T22:52:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67712024-11-07T22:52:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
67722024-11-07T22:52:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67732024-11-07T22:52:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
67742024-11-07T22:52:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67752024-11-07T22:52:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67762024-11-07T22:52:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67772024-11-07T22:52:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67782024-11-07T22:52:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67792024-11-07T22:52:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67802024-11-07T22:52:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67812024-11-07T22:52:20.820ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67822024-11-07T22:52:20.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67832024-11-07T22:52:20.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67842024-11-07T22:52:20.822ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.769342ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
67852024-11-07T22:52:20.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67862024-11-07T22:52:20.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67872024-11-07T22:52:20.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67882024-11-07T22:52:20.824ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67892024-11-07T22:52:20.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67902024-11-07T22:52:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67912024-11-07T22:52:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67922024-11-07T22:52:20.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67932024-11-07T22:52:20.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67942024-11-07T22:52:20.826ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67952024-11-07T22:52:20.827ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1234, tv_nsec: 916778994 } })
67962024-11-07T22:52:20.827ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67972024-11-07T22:52:20.827ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
67982024-11-07T22:52:20.828ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1234, tv_nsec: 917263557 } })
67992024-11-07T22:52:20.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68002024-11-07T22:52:20.828ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
68012024-11-07T22:52:20.828ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68022024-11-07T22:52:20.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
68032024-11-07T22:52:20.829ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68042024-11-07T22:52:20.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
68052024-11-07T22:52:20.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68062024-11-07T22:52:20.830ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68072024-11-07T22:52:20.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68082024-11-07T22:52:20.831ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68092024-11-07T22:52:20.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
68102024-11-07T22:52:20.833ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68112024-11-07T22:52:20.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68122024-11-07T22:52:20.835ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68132024-11-07T22:52:20.836ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1234, tv_nsec: 925439087 } })
68142024-11-07T22:52:20.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68152024-11-07T22:52:20.836ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
68162024-11-07T22:52:20.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68172024-11-07T22:52:20.837ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68182024-11-07T22:52:20.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68192024-11-07T22:52:20.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68202024-11-07T22:52:20.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68212024-11-07T22:52:20.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68222024-11-07T22:52:20.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68232024-11-07T22:52:20.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68242024-11-07T22:52:20.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68252024-11-07T22:52:20.840ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68262024-11-07T22:52:20.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
68272024-11-07T22:52:20.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68282024-11-07T22:52:20.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68292024-11-07T22:52:20.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68302024-11-07T22:52:20.842ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68312024-11-07T22:52:20.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68322024-11-07T22:52:20.860ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68332024-11-07T22:52:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68342024-11-07T22:52:20.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 42.557368ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
68352024-11-07T22:52:20.865ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
68362024-11-07T22:52:20.865ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.07625ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
68372024-11-07T22:52:20.868ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68382024-11-07T22:52:20.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
68392024-11-07T22:52:20.872ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68402024-11-07T22:52:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68412024-11-07T22:52:20.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.279162ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
68422024-11-07T22:52:20.878ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68432024-11-07T22:52:20.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68442024-11-07T22:52:20.880ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68452024-11-07T22:52:20.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
68462024-11-07T22:52:20.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68472024-11-07T22:52:20.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68482024-11-07T22:52:20.883ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
68492024-11-07T22:52:20.883ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.073825ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
68502024-11-07T22:52:20.885ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68512024-11-07T22:52:20.885ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 66.991117ms iteration = 20 status = 0
68522024-11-07T22:52:20.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68532024-11-07T22:52:20.887ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68542024-11-07T22:52:20.887ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.644302ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68552024-11-07T22:52:20.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68562024-11-07T22:52:20.889ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68572024-11-07T22:52:20.889ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
68582024-11-07T22:52:20.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68592024-11-07T22:52:20.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68602024-11-07T22:52:20.894ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68612024-11-07T22:52:20.895ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
68622024-11-07T22:52:20.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68632024-11-07T22:52:20.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68642024-11-07T22:52:20.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3cf58b8c-cae8-4d10-b7d6-495aebfe50df roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
68652024-11-07T22:52:20.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3cf58b8c-cae8-4d10-b7d6-495aebfe50df resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
68662024-11-07T22:52:20.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 90.519693ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68672024-11-07T22:52:20.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2334 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3cf58b8c-cae8-4d10-b7d6-495aebfe50df response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
68682024-11-07T22:52:20.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 94.055218ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
68692024-11-07T22:52:20.925ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
68702024-11-07T22:52:20.925ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68712024-11-07T22:52:20.926ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3fe7119-f0cd-4932-8d4a-35d6fd096edc", "content-length": "26", "date": "Thu, 07 Nov 2024 22:52:20 GMT"} })
68722024-11-07T22:52:20.926ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68732024-11-07T22:52:20.926ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68742024-11-07T22:52:20.926ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
68752024-11-07T22:52:20.926ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 107.84444ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
68762024-11-07T22:52:20.926ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 108.359844ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
68772024-11-07T22:52:20.928ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68782024-11-07T22:52:20.931ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
68792024-11-07T22:52:20.931ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68802024-11-07T22:52:20.932ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b85a334-f0e8-4a81-8554-d2d78329deb2", "content-length": "26", "date": "Thu, 07 Nov 2024 22:52:20 GMT"} })
68812024-11-07T22:52:20.932ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68822024-11-07T22:52:20.933ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68832024-11-07T22:52:20.941ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
68842024-11-07T22:52:20.941ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68852024-11-07T22:52:20.941ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8996f27e-cb24-4455-9b02-f8c231e36803", "content-length": "26", "date": "Thu, 07 Nov 2024 22:52:20 GMT"} })
68862024-11-07T22:52:20.941ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68872024-11-07T22:52:20.943ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
68882024-11-07T22:52:20.954ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68892024-11-07T22:52:20.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68902024-11-07T22:52:20.974ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 156.031831ms iteration = 23 status = {"physical_disks_added":0}
68912024-11-07T22:52:21.033ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
68922024-11-07T22:52:21.033ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68932024-11-07T22:52:21.035ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3eddc8ab-43eb-4515-8d9e-756557991f22", "content-length": "372", "date": "Thu, 07 Nov 2024 22:52:21 GMT"} })
68942024-11-07T22:52:21.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68952024-11-07T22:52:21.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68962024-11-07T22:52:21.055ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
68972024-11-07T22:52:21.056ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "12f9629f-a78f-4d52-b854-2e07706c5ab8", "content-length": "1", "date": "Thu, 07 Nov 2024 22:52:20 GMT"} })
68982024-11-07T22:52:21.057ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68992024-11-07T22:52:21.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69002024-11-07T22:52:21.060ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 241.509817ms iteration = 20 status = null
69012024-11-07T22:52:21.061ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 242.861294ms iteration = 20 status = {}
69022024-11-07T22:52:21.088ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69032024-11-07T22:52:21.088ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
69042024-11-07T22:52:21.088ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
69052024-11-07T22:52:21.088ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1f76dcf7-9d34-4ad4-9c8d-4238a97249c5", "date": "Thu, 07 Nov 2024 22:52:21 GMT"} })
69062024-11-07T22:52:21.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69072024-11-07T22:52:21.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69082024-11-07T22:52:21.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69092024-11-07T22:52:21.089ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69102024-11-07T22:52:21.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69112024-11-07T22:52:21.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69122024-11-07T22:52:21.092ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69132024-11-07T22:52:21.092ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69142024-11-07T22:52:21.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69152024-11-07T22:52:21.093ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69162024-11-07T22:52:21.094ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69172024-11-07T22:52:21.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69182024-11-07T22:52:21.096ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69192024-11-07T22:52:21.096ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69202024-11-07T22:52:21.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69212024-11-07T22:52:21.100ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
69222024-11-07T22:52:21.100ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69232024-11-07T22:52:21.100ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4c343e88-122f-402d-af97-0e562d7fad93", "date": "Thu, 07 Nov 2024 22:52:21 GMT"} })
69242024-11-07T22:52:21.102ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 284.289511ms iteration = 21 status = {}
69252024-11-07T22:52:21.130ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69262024-11-07T22:52:21.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69272024-11-07T22:52:21.132ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
69282024-11-07T22:52:21.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69292024-11-07T22:52:21.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69302024-11-07T22:52:21.141ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
69312024-11-07T22:52:21.141ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
69322024-11-07T22:52:21.142ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fabd920e-a817-4241-bb13-b39d741e3006", "content-length": "134", "date": "Thu, 07 Nov 2024 22:52:20 GMT"} })
69332024-11-07T22:52:21.142ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
69342024-11-07T22:52:21.142ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
69352024-11-07T22:52:21.142ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "692cda2d-84fa-46eb-bf84-900b56e0bd29", "content-length": "691", "date": "Thu, 07 Nov 2024 22:52:21 GMT"} })
69362024-11-07T22:52:21.142ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
69372024-11-07T22:52:21.142ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
69382024-11-07T22:52:21.142ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
69392024-11-07T22:52:21.142ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
69402024-11-07T22:52:21.142ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
69412024-11-07T22:52:21.142ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69422024-11-07T22:52:21.142ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69432024-11-07T22:52:21.142ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69442024-11-07T22:52:21.142ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69452024-11-07T22:52:21.142ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69462024-11-07T22:52:21.142ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69472024-11-07T22:52:21.142ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
69482024-11-07T22:52:21.142ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69492024-11-07T22:52:21.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69502024-11-07T22:52:21.144ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 325.314409ms iteration = 20 status = {}
69512024-11-07T22:52:21.144ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
69522024-11-07T22:52:21.144ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2147fa13-78ac-48ed-89e2-124824e54ab8", "content-length": "2", "date": "Thu, 07 Nov 2024 22:52:20 GMT"} })
69532024-11-07T22:52:21.144ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
69542024-11-07T22:52:21.144ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "eea40b4f-13f6-4c4e-855f-5257cdd3d9ba", "content-length": "52", "date": "Thu, 07 Nov 2024 22:52:20 GMT"} })
69552024-11-07T22:52:21.144ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
69562024-11-07T22:52:21.144ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
69572024-11-07T22:52:21.263ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7df6d093-d124-4b50-8eae-55cf716d2b85", "date": "Thu, 07 Nov 2024 22:52:21 GMT"} })
69582024-11-07T22:52:21.263ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
69592024-11-07T22:52:21.263ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
69602024-11-07T22:52:21.263ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e14a5a0e-de5c-4b97-b906-3704122e127c", "content-length": "682", "date": "Thu, 07 Nov 2024 22:52:21 GMT"} })
69612024-11-07T22:52:21.263ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69622024-11-07T22:52:21.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69632024-11-07T22:52:21.266ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69642024-11-07T22:52:21.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69652024-11-07T22:52:21.269ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69662024-11-07T22:52:21.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69672024-11-07T22:52:21.271ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69682024-11-07T22:52:21.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69692024-11-07T22:52:21.278ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 460.191107ms iteration = 20 status = {}
69702024-11-07T22:52:21.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 7073b4bf-7a4b-4937-8fcd-90275fdcce67 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
69712024-11-07T22:52:21.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 7073b4bf-7a4b-4937-8fcd-90275fdcce67 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
69722024-11-07T22:52:21.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 7073b4bf-7a4b-4937-8fcd-90275fdcce67 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
69732024-11-07T22:52:21.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 1d7cbbdd-0171-4b53-b7cb-7d99a5f26663 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
69742024-11-07T22:52:21.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 1d7cbbdd-0171-4b53-b7cb-7d99a5f26663 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
69752024-11-07T22:52:21.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 1d7cbbdd-0171-4b53-b7cb-7d99a5f26663 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
69762024-11-07T22:52:21.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1df5da95-5477-4b7d-a07e-da33efc2b824 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69772024-11-07T22:52:21.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1df5da95-5477-4b7d-a07e-da33efc2b824 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69782024-11-07T22:52:21.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1df5da95-5477-4b7d-a07e-da33efc2b824 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69792024-11-07T22:52:21.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = db08a630-23d5-4c85-a663-b010cff01757 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
69802024-11-07T22:52:21.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = db08a630-23d5-4c85-a663-b010cff01757 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
69812024-11-07T22:52:21.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = db08a630-23d5-4c85-a663-b010cff01757 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
69822024-11-07T22:52:22.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 05de258a-f08c-4b94-a022-1af707f90a2f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69832024-11-07T22:52:22.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 05de258a-f08c-4b94-a022-1af707f90a2f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69842024-11-07T22:52:22.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1697 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 05de258a-f08c-4b94-a022-1af707f90a2f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69852024-11-07T22:52:23.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 66ded602-4be5-488f-8a88-5d55a906d1b7 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69862024-11-07T22:52:23.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 66ded602-4be5-488f-8a88-5d55a906d1b7 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69872024-11-07T22:52:23.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 66ded602-4be5-488f-8a88-5d55a906d1b7 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69882024-11-07T22:52:25.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4447b2fa-e396-4f8b-9358-e6d3c17e2dbf roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69892024-11-07T22:52:25.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4447b2fa-e396-4f8b-9358-e6d3c17e2dbf resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69902024-11-07T22:52:25.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4447b2fa-e396-4f8b-9358-e6d3c17e2dbf response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69912024-11-07T22:52:26.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2739daec-942a-4929-a5bf-b9fcbf45bee7 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69922024-11-07T22:52:26.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2739daec-942a-4929-a5bf-b9fcbf45bee7 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69932024-11-07T22:52:26.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1959 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2739daec-942a-4929-a5bf-b9fcbf45bee7 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69942024-11-07T22:52:27.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c32222e1-280d-4923-915d-c4cf2d1524e7 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69952024-11-07T22:52:27.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c32222e1-280d-4923-915d-c4cf2d1524e7 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69962024-11-07T22:52:27.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c32222e1-280d-4923-915d-c4cf2d1524e7 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69972024-11-07T22:52:28.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 157b16bd-b162-4f6e-8348-007010398198 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69982024-11-07T22:52:28.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 157b16bd-b162-4f6e-8348-007010398198 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
69992024-11-07T22:52:28.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1795 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 157b16bd-b162-4f6e-8348-007010398198 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70002024-11-07T22:52:29.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d3a109ba-9bf8-40b1-b184-9b7ebcad58e1 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70012024-11-07T22:52:29.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d3a109ba-9bf8-40b1-b184-9b7ebcad58e1 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70022024-11-07T22:52:29.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2000 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d3a109ba-9bf8-40b1-b184-9b7ebcad58e1 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70032024-11-07T22:52:30.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2ff93b84-4052-4705-b682-448b8bf8e34c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70042024-11-07T22:52:30.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2ff93b84-4052-4705-b682-448b8bf8e34c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70052024-11-07T22:52:30.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2ff93b84-4052-4705-b682-448b8bf8e34c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70062024-11-07T22:52:30.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
70072024-11-07T22:52:30.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
70082024-11-07T22:52:30.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70092024-11-07T22:52:30.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70102024-11-07T22:52:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70112024-11-07T22:52:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70122024-11-07T22:52:30.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70132024-11-07T22:52:30.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70142024-11-07T22:52:30.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70152024-11-07T22:52:30.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70162024-11-07T22:52:30.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70172024-11-07T22:52:30.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70182024-11-07T22:52:30.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70192024-11-07T22:52:30.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70202024-11-07T22:52:30.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70212024-11-07T22:52:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
70222024-11-07T22:52:30.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70232024-11-07T22:52:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70242024-11-07T22:52:30.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
70252024-11-07T22:52:30.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.951879ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
70262024-11-07T22:52:30.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.073762ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70272024-11-07T22:52:31.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 932d885d-dae8-4346-add0-d4c6d5869e36 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70282024-11-07T22:52:31.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 932d885d-dae8-4346-add0-d4c6d5869e36 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70292024-11-07T22:52:31.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 932d885d-dae8-4346-add0-d4c6d5869e36 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70302024-11-07T22:52:31.653ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1305 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 1fc5940a-4350-43a6-962c-176d6fc6003f response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
70312024-11-07T22:52:32.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d7263552-2b45-4353-b86a-77fe5c4481c9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70322024-11-07T22:52:32.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d7263552-2b45-4353-b86a-77fe5c4481c9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70332024-11-07T22:52:32.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d7263552-2b45-4353-b86a-77fe5c4481c9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70342024-11-07T22:52:33.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8e560465-96b6-4dd6-ba81-c02fd1d6c81c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70352024-11-07T22:52:33.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8e560465-96b6-4dd6-ba81-c02fd1d6c81c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70362024-11-07T22:52:33.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8e560465-96b6-4dd6-ba81-c02fd1d6c81c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70372024-11-07T22:52:34.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 84591c3d-461e-4dd4-bb3e-f1c11d1ac859 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70382024-11-07T22:52:34.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 84591c3d-461e-4dd4-bb3e-f1c11d1ac859 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70392024-11-07T22:52:34.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 84591c3d-461e-4dd4-bb3e-f1c11d1ac859 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70402024-11-07T22:52:35.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e3767f32-4125-4a8b-8746-f1aebb295fec roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70412024-11-07T22:52:35.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e3767f32-4125-4a8b-8746-f1aebb295fec resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70422024-11-07T22:52:35.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e3767f32-4125-4a8b-8746-f1aebb295fec response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70432024-11-07T22:52:36.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = da730348-2d48-4350-9071-4e5113b3b9c9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70442024-11-07T22:52:36.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = da730348-2d48-4350-9071-4e5113b3b9c9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70452024-11-07T22:52:36.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2182 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = da730348-2d48-4350-9071-4e5113b3b9c9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70462024-11-07T22:52:37.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f820596f-8dc9-4cad-a8bc-336109659ff2 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70472024-11-07T22:52:37.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f820596f-8dc9-4cad-a8bc-336109659ff2 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70482024-11-07T22:52:37.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1730 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f820596f-8dc9-4cad-a8bc-336109659ff2 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70492024-11-07T22:52:38.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a2015330-0b0f-4ae0-8929-74f9f59b8662 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70502024-11-07T22:52:38.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a2015330-0b0f-4ae0-8929-74f9f59b8662 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70512024-11-07T22:52:38.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2876 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a2015330-0b0f-4ae0-8929-74f9f59b8662 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70522024-11-07T22:52:39.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e5662f82-4b7e-4f84-9ad6-dea7b41438a9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70532024-11-07T22:52:39.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e5662f82-4b7e-4f84-9ad6-dea7b41438a9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70542024-11-07T22:52:39.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e5662f82-4b7e-4f84-9ad6-dea7b41438a9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70552024-11-07T22:52:40.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 62002530-b4c0-4920-a1d7-2d3753b0f797 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70562024-11-07T22:52:40.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 62002530-b4c0-4920-a1d7-2d3753b0f797 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70572024-11-07T22:52:40.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1990 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 62002530-b4c0-4920-a1d7-2d3753b0f797 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70582024-11-07T22:52:40.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
70592024-11-07T22:52:40.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
70602024-11-07T22:52:40.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70612024-11-07T22:52:40.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70622024-11-07T22:52:40.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70632024-11-07T22:52:40.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70642024-11-07T22:52:40.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70652024-11-07T22:52:40.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70662024-11-07T22:52:40.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70672024-11-07T22:52:40.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.227777ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70682024-11-07T22:52:40.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70692024-11-07T22:52:40.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70702024-11-07T22:52:40.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70712024-11-07T22:52:40.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70722024-11-07T22:52:40.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70732024-11-07T22:52:40.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70742024-11-07T22:52:40.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
70752024-11-07T22:52:40.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70762024-11-07T22:52:40.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70772024-11-07T22:52:40.837ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
70782024-11-07T22:52:40.837ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.112859ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
70792024-11-07T22:52:41.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 27ba21ee-0ee5-4ded-8a1d-555df7b52445 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70802024-11-07T22:52:41.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 27ba21ee-0ee5-4ded-8a1d-555df7b52445 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70812024-11-07T22:52:41.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2016 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 27ba21ee-0ee5-4ded-8a1d-555df7b52445 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70822024-11-07T22:52:42.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 87002058-d315-48fd-84e4-0ec125e509c3 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70832024-11-07T22:52:42.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 87002058-d315-48fd-84e4-0ec125e509c3 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70842024-11-07T22:52:42.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2230 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 87002058-d315-48fd-84e4-0ec125e509c3 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70852024-11-07T22:52:43.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 608734eb-07c3-4ed4-98cf-0c42810b4b91 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70862024-11-07T22:52:43.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 608734eb-07c3-4ed4-98cf-0c42810b4b91 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70872024-11-07T22:52:43.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 608734eb-07c3-4ed4-98cf-0c42810b4b91 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70882024-11-07T22:52:44.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b0f2981b-9142-4d28-a748-14f5b497293e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70892024-11-07T22:52:44.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b0f2981b-9142-4d28-a748-14f5b497293e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70902024-11-07T22:52:44.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b0f2981b-9142-4d28-a748-14f5b497293e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70912024-11-07T22:52:45.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 00f8f54e-810e-4c7e-b375-e2672c0ef193 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70922024-11-07T22:52:45.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 00f8f54e-810e-4c7e-b375-e2672c0ef193 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70932024-11-07T22:52:45.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1921 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 00f8f54e-810e-4c7e-b375-e2672c0ef193 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70942024-11-07T22:52:46.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 661bce3e-7d1b-4f19-9d54-8c99b1b38af7 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70952024-11-07T22:52:46.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 661bce3e-7d1b-4f19-9d54-8c99b1b38af7 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70962024-11-07T22:52:46.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 661bce3e-7d1b-4f19-9d54-8c99b1b38af7 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70972024-11-07T22:52:46.655ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1632 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 22569c61-add6-48f6-b517-818db78f767e response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
70982024-11-07T22:52:47.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e3bab0af-3a77-451a-9edd-3d1b53f53b8b roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
70992024-11-07T22:52:47.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e3bab0af-3a77-451a-9edd-3d1b53f53b8b resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
71002024-11-07T22:52:47.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e3bab0af-3a77-451a-9edd-3d1b53f53b8b response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
71012024-11-07T22:52:48.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ad760bd9-e709-4adb-a379-d30a4444caa7 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
71022024-11-07T22:52:48.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ad760bd9-e709-4adb-a379-d30a4444caa7 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
71032024-11-07T22:52:48.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ad760bd9-e709-4adb-a379-d30a4444caa7 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
71042024-11-07T22:52:49.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 24174184-2486-49b0-a6eb-541dacfd4d19 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
71052024-11-07T22:52:49.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 24174184-2486-49b0-a6eb-541dacfd4d19 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
71062024-11-07T22:52:49.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2154 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 24174184-2486-49b0-a6eb-541dacfd4d19 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
71072024-11-07T22:52:50.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b8f01fbd-b42d-4887-8618-db879e1c987f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
71082024-11-07T22:52:50.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b8f01fbd-b42d-4887-8618-db879e1c987f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
71092024-11-07T22:52:50.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1691 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b8f01fbd-b42d-4887-8618-db879e1c987f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
71102024-11-07T22:52:50.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
71112024-11-07T22:52:50.818ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
71122024-11-07T22:52:50.818ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
71132024-11-07T22:52:50.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71142024-11-07T22:52:50.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
71152024-11-07T22:52:50.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71162024-11-07T22:52:50.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
71172024-11-07T22:52:50.818ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
71182024-11-07T22:52:50.818ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
71192024-11-07T22:52:50.818ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
71202024-11-07T22:52:50.818ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-07 22:42:50.818769372 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
71212024-11-07T22:52:50.818ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
71222024-11-07T22:52:50.818ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
71232024-11-07T22:52:50.818ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
71242024-11-07T22:52:50.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
71252024-11-07T22:52:50.818ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
71262024-11-07T22:52:50.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71272024-11-07T22:52:50.818ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
71282024-11-07T22:52:50.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
71292024-11-07T22:52:50.818ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
71302024-11-07T22:52:50.818ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
71312024-11-07T22:52:50.818ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531
71322024-11-07T22:52:50.819ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
71332024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.261\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531"}
71342024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
71352024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
71362024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71372024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71382024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
71392024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
71402024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
71412024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71422024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
71432024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
71442024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71452024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
71462024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
71472024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
71482024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
71492024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
71502024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
71512024-11-07T22:52:50.819ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
71522024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
71532024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
71542024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
71552024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71562024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
71572024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71582024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
71592024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71602024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
71612024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71622024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
71632024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71642024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
71652024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71662024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
71672024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71682024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
71692024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71702024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71712024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
71722024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
71732024-11-07T22:52:50.819ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
71742024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
71752024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
71762024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71772024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71782024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71792024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
71802024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
71812024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71822024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
71832024-11-07T22:52:50.819ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
71842024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71852024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71862024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71872024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
71882024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71892024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
71902024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71912024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
71922024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
71932024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71942024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71952024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71962024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
71972024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71982024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
71992024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72002024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72012024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72022024-11-07T22:52:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72032024-11-07T22:52:50.819ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19da6a5b-073a-4e12-8775-91fc61c1e962.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1264, tv_nsec: 909155588 } })
72042024-11-07T22:52:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72052024-11-07T22:52:50.820ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a127151b-10b2-4835-91ce-b493ecd30481.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("de9282a1-0aa7-4ad8-a39a-58f19d05b651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1264, tv_nsec: 909183769 } })
72062024-11-07T22:52:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72072024-11-07T22:52:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72082024-11-07T22:52:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
72092024-11-07T22:52:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
72102024-11-07T22:52:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.500621ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
72112024-11-07T22:52:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
72122024-11-07T22:52:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.769888ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
72132024-11-07T22:52:50.821ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72142024-11-07T22:52:50.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72152024-11-07T22:52:50.823ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.43921ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
72162024-11-07T22:52:50.823ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72172024-11-07T22:52:50.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72182024-11-07T22:52:50.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72192024-11-07T22:52:50.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72202024-11-07T22:52:50.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72212024-11-07T22:52:50.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72222024-11-07T22:52:50.827ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72232024-11-07T22:52:50.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72242024-11-07T22:52:50.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72252024-11-07T22:52:50.828ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.457645ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
72262024-11-07T22:52:50.828ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72272024-11-07T22:52:50.829ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
72282024-11-07T22:52:50.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
72292024-11-07T22:52:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
72302024-11-07T22:52:50.830ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72312024-11-07T22:52:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72322024-11-07T22:52:50.831ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
72332024-11-07T22:52:50.831ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
72342024-11-07T22:52:50.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
72352024-11-07T22:52:50.832ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72362024-11-07T22:52:50.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72372024-11-07T22:52:50.832ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72382024-11-07T22:52:50.833ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1264, tv_nsec: 922285182 } })
72392024-11-07T22:52:50.833ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-07 22:42:50.818769372 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
72402024-11-07T22:52:50.833ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.357607ms iteration = 11 status = {"expiration":"2024-11-07T22:42:50.818769372Z","pruned":[]}
72412024-11-07T22:52:50.833ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
72422024-11-07T22:52:50.834ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72432024-11-07T22:52:50.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
72442024-11-07T22:52:50.835ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72452024-11-07T22:52:50.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72462024-11-07T22:52:50.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
72472024-11-07T22:52:50.837ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
72482024-11-07T22:52:50.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
72492024-11-07T22:52:50.839ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1264, tv_nsec: 929016374 } })
72502024-11-07T22:52:50.842ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
72512024-11-07T22:52:50.842ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72522024-11-07T22:52:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72532024-11-07T22:52:50.843ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 24.586834ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
72542024-11-07T22:52:50.845ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72552024-11-07T22:52:50.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72562024-11-07T22:52:50.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72572024-11-07T22:52:50.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72582024-11-07T22:52:50.850ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
72592024-11-07T22:52:50.850ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
72602024-11-07T22:52:50.850ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 31.252983ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
72612024-11-07T22:52:50.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72622024-11-07T22:52:50.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72632024-11-07T22:52:50.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72642024-11-07T22:52:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72652024-11-07T22:52:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72662024-11-07T22:52:50.852ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
72672024-11-07T22:52:50.852ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 33.34158ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
72682024-11-07T22:52:50.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72692024-11-07T22:52:50.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 38.438057ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
72702024-11-07T22:52:50.857ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72712024-11-07T22:52:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72722024-11-07T22:52:50.857ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72732024-11-07T22:52:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72742024-11-07T22:52:50.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 38.967062ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
72752024-11-07T22:52:50.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72762024-11-07T22:52:50.859ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(9de0a984-4ada-4a33-a4f2-78663383235e, 0), (412964a7-f549-48bf-9c4a-862ceb9addd0, 0), (27155659-1bdb-435b-a4cc-41e9c09dff71, 0), (a02b5199-8643-45b7-9ebc-60a3483be6e7, 0)] collection_id = 9de0a984-4ada-4a33-a4f2-78663383235e
72772024-11-07T22:52:50.859ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
72782024-11-07T22:52:50.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
72792024-11-07T22:52:50.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72802024-11-07T22:52:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
72812024-11-07T22:52:50.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72822024-11-07T22:52:50.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72832024-11-07T22:52:50.865ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
72842024-11-07T22:52:50.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
72852024-11-07T22:52:50.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72862024-11-07T22:52:50.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72872024-11-07T22:52:50.868ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = b1b779a9-0fdd-4a8b-9846-79fadd76904f
72882024-11-07T22:52:50.868ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = b0a5808d-a49d-4b85-a747-44ee67bc4c63
72892024-11-07T22:52:50.868ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 881120de-35f2-4d00-9bd1-bebfd40b14ab
72902024-11-07T22:52:50.868ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 881120de-35f2-4d00-9bd1-bebfd40b14ab
72912024-11-07T22:52:50.868ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = b0a5808d-a49d-4b85-a747-44ee67bc4c63
72922024-11-07T22:52:50.868ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = b1b779a9-0fdd-4a8b-9846-79fadd76904f
72932024-11-07T22:52:50.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72942024-11-07T22:52:50.870ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 51.769586ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
72952024-11-07T22:52:50.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72962024-11-07T22:52:50.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72972024-11-07T22:52:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72982024-11-07T22:52:50.875ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72992024-11-07T22:52:50.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73002024-11-07T22:52:50.881ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73012024-11-07T22:52:50.884ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
73022024-11-07T22:52:50.884ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73032024-11-07T22:52:50.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73042024-11-07T22:52:50.888ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1264, tv_nsec: 977112262 } })
73052024-11-07T22:52:50.888ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
73062024-11-07T22:52:50.888ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73072024-11-07T22:52:50.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73082024-11-07T22:52:50.890ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73092024-11-07T22:52:50.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73102024-11-07T22:52:50.890ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73112024-11-07T22:52:50.891ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73122024-11-07T22:52:50.891ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
73132024-11-07T22:52:50.891ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73142024-11-07T22:52:50.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73152024-11-07T22:52:50.893ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73162024-11-07T22:52:50.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73172024-11-07T22:52:50.893ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73182024-11-07T22:52:50.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73192024-11-07T22:52:50.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73202024-11-07T22:52:50.894ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73212024-11-07T22:52:50.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73222024-11-07T22:52:50.895ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
73232024-11-07T22:52:50.895ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
73242024-11-07T22:52:50.895ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 76.805122ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
73252024-11-07T22:52:50.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73262024-11-07T22:52:50.896ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73272024-11-07T22:52:50.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73282024-11-07T22:52:50.898ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73292024-11-07T22:52:50.898ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73302024-11-07T22:52:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73312024-11-07T22:52:50.898ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
73322024-11-07T22:52:50.898ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 80.157773ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
73332024-11-07T22:52:50.899ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73342024-11-07T22:52:50.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73352024-11-07T22:52:50.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73362024-11-07T22:52:50.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73372024-11-07T22:52:50.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.383106ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
73382024-11-07T22:52:50.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73392024-11-07T22:52:50.903ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
73402024-11-07T22:52:50.903ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
73412024-11-07T22:52:50.903ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
73422024-11-07T22:52:50.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
73432024-11-07T22:52:50.903ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73442024-11-07T22:52:50.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73452024-11-07T22:52:50.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73462024-11-07T22:52:50.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73472024-11-07T22:52:50.906ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73482024-11-07T22:52:50.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73492024-11-07T22:52:50.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73502024-11-07T22:52:50.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
73512024-11-07T22:52:50.911ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73522024-11-07T22:52:50.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73532024-11-07T22:52:50.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73542024-11-07T22:52:50.914ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
73552024-11-07T22:52:50.914ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
73562024-11-07T22:52:50.914ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
73572024-11-07T22:52:50.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73582024-11-07T22:52:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73592024-11-07T22:52:50.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73602024-11-07T22:52:50.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
73612024-11-07T22:52:50.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73622024-11-07T22:52:50.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73632024-11-07T22:52:50.918ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
73642024-11-07T22:52:50.918ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 99.784652ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
73652024-11-07T22:52:50.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73662024-11-07T22:52:50.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73672024-11-07T22:52:50.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73682024-11-07T22:52:50.928ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 110.026829ms iteration = 21 status = 0
73692024-11-07T22:52:50.939ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
73702024-11-07T22:52:50.956ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73712024-11-07T22:52:50.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73722024-11-07T22:52:50.962ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 143.02879ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73732024-11-07T22:52:50.962ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 9de0a984-4ada-4a33-a4f2-78663383235e file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
73742024-11-07T22:52:50.963ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
73752024-11-07T22:52:50.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
73762024-11-07T22:52:50.965ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73772024-11-07T22:52:50.965ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
73782024-11-07T22:52:50.965ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73792024-11-07T22:52:50.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73802024-11-07T22:52:50.966ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73812024-11-07T22:52:50.966ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
73822024-11-07T22:52:50.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73832024-11-07T22:52:50.969ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(412964a7-f549-48bf-9c4a-862ceb9addd0, 0), (27155659-1bdb-435b-a4cc-41e9c09dff71, 0), (a02b5199-8643-45b7-9ebc-60a3483be6e7, 0)]
73842024-11-07T22:52:50.969ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73852024-11-07T22:52:50.969ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1265, tv_nsec: 58970641 } })
73862024-11-07T22:52:50.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73872024-11-07T22:52:50.971ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73882024-11-07T22:52:50.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
73892024-11-07T22:52:50.977ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73902024-11-07T22:52:50.977ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73912024-11-07T22:52:50.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73922024-11-07T22:52:50.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73932024-11-07T22:52:50.981ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73942024-11-07T22:52:50.983ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73952024-11-07T22:52:50.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73962024-11-07T22:52:50.985ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
73972024-11-07T22:52:50.985ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73982024-11-07T22:52:50.985ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73992024-11-07T22:52:50.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74002024-11-07T22:52:50.986ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
74012024-11-07T22:52:50.986ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 0 version = 2
74022024-11-07T22:52:50.986ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74032024-11-07T22:52:50.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74042024-11-07T22:52:50.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74052024-11-07T22:52:50.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
74062024-11-07T22:52:50.990ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74072024-11-07T22:52:50.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74082024-11-07T22:52:50.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
74092024-11-07T22:52:50.993ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74102024-11-07T22:52:50.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74112024-11-07T22:52:50.999ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74122024-11-07T22:52:51.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74132024-11-07T22:52:51.008ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 1 version = 2
74142024-11-07T22:52:51.008ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
74152024-11-07T22:52:51.008ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-07 22:43:11.643428 UTC dns_group = external generation = 2
74162024-11-07T22:52:51.008ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 189.683218ms iteration = 12 status = {"generation":2}
74172024-11-07T22:52:51.009ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74182024-11-07T22:52:51.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74192024-11-07T22:52:51.018ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74202024-11-07T22:52:51.018ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 199.718619ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
74212024-11-07T22:52:51.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74222024-11-07T22:52:51.022ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74232024-11-07T22:52:51.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74242024-11-07T22:52:51.023ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74252024-11-07T22:52:51.023ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
74262024-11-07T22:52:51.023ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 203.83426ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
74272024-11-07T22:52:51.038ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74282024-11-07T22:52:51.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74292024-11-07T22:52:51.063ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-07T22:42:48.907310Z, time_modified: 2024-11-07T22:42:48.907310Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }) }
74302024-11-07T22:52:51.063ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 244.163918ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]}},"default_endpoint":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
74312024-11-07T22:52:51.068ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
74322024-11-07T22:52:51.068ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
74332024-11-07T22:52:51.068ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74342024-11-07T22:52:51.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74352024-11-07T22:52:51.077ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74362024-11-07T22:52:51.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
74372024-11-07T22:52:51.081ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74382024-11-07T22:52:51.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74392024-11-07T22:52:51.084ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
74402024-11-07T22:52:51.084ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74412024-11-07T22:52:51.084ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "82548cc1-270c-41e5-8edd-e00e8921549b", "content-length": "26", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74422024-11-07T22:52:51.084ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74432024-11-07T22:52:51.088ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74442024-11-07T22:52:51.089ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
74452024-11-07T22:52:51.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74462024-11-07T22:52:51.098ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
74472024-11-07T22:52:51.098ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
74482024-11-07T22:52:51.098ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-07 22:43:11.086261 UTC dns_group = internal generation = 1
74492024-11-07T22:52:51.098ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 279.07647ms iteration = 12 status = {"generation":1}
74502024-11-07T22:52:51.100ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74512024-11-07T22:52:51.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
74522024-11-07T22:52:51.106ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74532024-11-07T22:52:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74542024-11-07T22:52:51.111ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 292.091962ms iteration = 24 status = {"physical_disks_added":0}
74552024-11-07T22:52:51.181ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
74562024-11-07T22:52:51.181ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
74572024-11-07T22:52:51.181ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
74582024-11-07T22:52:51.181ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "aff002de-5e93-459c-a700-385db9aff972", "content-length": "476", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74592024-11-07T22:52:51.181ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
74602024-11-07T22:52:51.181ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "413c66c1-210a-451b-8f7e-5cc919052eae", "content-length": "734", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74612024-11-07T22:52:51.181ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
74622024-11-07T22:52:51.182ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a2086dc-309c-42ad-8960-53dbe332a435", "content-length": "111", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74632024-11-07T22:52:51.182ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
74642024-11-07T22:52:51.182ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a466b82a-fb88-4e84-b44e-1a07a4969e0a", "content-length": "111", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74652024-11-07T22:52:51.182ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
74662024-11-07T22:52:51.182ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "471118db-c625-4043-913f-9b94d89fe16c", "content-length": "167", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74672024-11-07T22:52:51.183ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
74682024-11-07T22:52:51.183ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "83c1a248-ac68-42f2-8b8d-cf51b93dc095", "content-length": "167", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74692024-11-07T22:52:51.183ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
74702024-11-07T22:52:51.183ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4004211b-0d99-441b-a284-a39664ca985a", "content-length": "175", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74712024-11-07T22:52:51.183ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
74722024-11-07T22:52:51.184ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "38be54e8-044f-46f9-b297-45b97f4f4482", "content-length": "175", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74732024-11-07T22:52:51.184ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
74742024-11-07T22:52:51.184ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c42bb60d-4186-45c1-a903-d8cf9e156e93", "content-length": "702", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74752024-11-07T22:52:51.184ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
74762024-11-07T22:52:51.184ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "67ce7338-fba5-4db5-a2ae-306326e47c75", "content-length": "727", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74772024-11-07T22:52:51.184ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
74782024-11-07T22:52:51.184ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cccc0fac-ba6c-444a-a158-3ae3b8a063a2", "content-length": "729", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74792024-11-07T22:52:51.184ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
74802024-11-07T22:52:51.184ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff5fb102-e6a2-4e72-899e-3d97f8ea6973", "content-length": "728", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74812024-11-07T22:52:51.184ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
74822024-11-07T22:52:51.185ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ddb4a7c-3eca-4977-b1b5-1a20ecab8ad1", "content-length": "722", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74832024-11-07T22:52:51.185ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
74842024-11-07T22:52:51.185ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fe7e30a-4b95-4bc3-a959-197c68f2e3dd", "content-length": "109", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74852024-11-07T22:52:51.185ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
74862024-11-07T22:52:51.185ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "90edf562-4228-4e3e-a9e6-4f65cf252597", "content-length": "109", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74872024-11-07T22:52:51.185ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
74882024-11-07T22:52:51.186ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "abc145fe-5b73-42f9-a006-47ab6e19c73b", "content-length": "169", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74892024-11-07T22:52:51.186ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
74902024-11-07T22:52:51.186ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c16bf36f-4f29-4d2f-8d73-03ccb4fb9669", "content-length": "169", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74912024-11-07T22:52:51.186ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
74922024-11-07T22:52:51.186ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "37615795-32ee-47d1-a3d9-a3c839db0e3f", "content-length": "178", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74932024-11-07T22:52:51.186ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
74942024-11-07T22:52:51.188ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ab7a16f-1242-4644-8975-5316c9404b19", "content-length": "178", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74952024-11-07T22:52:51.188ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
74962024-11-07T22:52:51.188ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e915195d-d3b8-47a2-a70a-07ccfcad027e", "content-length": "702", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74972024-11-07T22:52:51.189ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
74982024-11-07T22:52:51.189ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "12590a53-2320-49fe-80c9-8d185cf464ed", "content-length": "727", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
74992024-11-07T22:52:51.189ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
75002024-11-07T22:52:51.189ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c8060ff-aa69-44c6-97ed-db151752a79c", "content-length": "729", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
75012024-11-07T22:52:51.189ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
75022024-11-07T22:52:51.189ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a12fde3-a517-491a-91b6-0b30bb6ec8be", "content-length": "728", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
75032024-11-07T22:52:51.189ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
75042024-11-07T22:52:51.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
75052024-11-07T22:52:51.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75062024-11-07T22:52:51.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75072024-11-07T22:52:51.255ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
75082024-11-07T22:52:51.255ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75092024-11-07T22:52:51.255ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b1dda27-8baa-4854-a8b6-3ac4520af8fd", "content-length": "26", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
75102024-11-07T22:52:51.255ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75112024-11-07T22:52:51.258ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75122024-11-07T22:52:51.262ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
75132024-11-07T22:52:51.262ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75142024-11-07T22:52:51.263ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "533b7758-6780-4191-85ea-3d6f807768dd", "content-length": "26", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
75152024-11-07T22:52:51.263ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75162024-11-07T22:52:51.263ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
75172024-11-07T22:52:51.263ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0fd07756-24a5-430f-8fbe-581952b30601", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75182024-11-07T22:52:51.263ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75192024-11-07T22:52:51.266ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75202024-11-07T22:52:51.266ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "866fad54-73b0-4e4a-84dc-e64c1341d7da", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75212024-11-07T22:52:51.266ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75222024-11-07T22:52:51.267ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75232024-11-07T22:52:51.267ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 448.854053ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
75242024-11-07T22:52:51.278ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
75252024-11-07T22:52:51.305ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
75262024-11-07T22:52:51.305ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75272024-11-07T22:52:51.306ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6521c71-71a0-490a-bf2a-98ec9d2aa784", "content-length": "372", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
75282024-11-07T22:52:51.306ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75292024-11-07T22:52:51.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75302024-11-07T22:52:51.307ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75312024-11-07T22:52:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75322024-11-07T22:52:51.310ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75332024-11-07T22:52:51.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75342024-11-07T22:52:51.313ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75352024-11-07T22:52:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75362024-11-07T22:52:51.315ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75372024-11-07T22:52:51.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75382024-11-07T22:52:51.337ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75392024-11-07T22:52:51.339ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
75402024-11-07T22:52:51.339ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
75412024-11-07T22:52:51.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
75422024-11-07T22:52:51.349ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75432024-11-07T22:52:51.351ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75442024-11-07T22:52:51.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75452024-11-07T22:52:51.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75462024-11-07T22:52:51.353ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
75472024-11-07T22:52:51.353ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
75482024-11-07T22:52:51.353ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5e7489db-a5ce-4970-ab35-cc270d698906", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
75492024-11-07T22:52:51.353ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75502024-11-07T22:52:51.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75512024-11-07T22:52:51.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75522024-11-07T22:52:51.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75532024-11-07T22:52:51.355ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75542024-11-07T22:52:51.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75552024-11-07T22:52:51.358ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75562024-11-07T22:52:51.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75572024-11-07T22:52:51.362ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
75582024-11-07T22:52:51.362ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75592024-11-07T22:52:51.362ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9ba10cdd-f374-49a9-b172-758a7436bb18", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
75602024-11-07T22:52:51.364ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 545.674334ms iteration = 22 status = {}
75612024-11-07T22:52:51.380ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75622024-11-07T22:52:51.383ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
75632024-11-07T22:52:51.383ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
75642024-11-07T22:52:51.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
75652024-11-07T22:52:51.394ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75662024-11-07T22:52:51.395ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75672024-11-07T22:52:51.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75682024-11-07T22:52:51.396ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75692024-11-07T22:52:51.396ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75702024-11-07T22:52:51.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75712024-11-07T22:52:51.401ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
75722024-11-07T22:52:51.401ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e80c7827-c6e7-40ef-bbc9-953db6a611b6", "content-length": "1", "date": "Thu, 07 Nov 2024 22:52:50 GMT"} })
75732024-11-07T22:52:51.403ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75742024-11-07T22:52:51.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75752024-11-07T22:52:51.405ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 586.001952ms iteration = 21 status = null
75762024-11-07T22:52:51.433ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75772024-11-07T22:52:51.437ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
75782024-11-07T22:52:51.437ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75792024-11-07T22:52:51.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75802024-11-07T22:52:51.439ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75812024-11-07T22:52:51.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75822024-11-07T22:52:51.441ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75832024-11-07T22:52:51.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75842024-11-07T22:52:51.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75852024-11-07T22:52:51.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75862024-11-07T22:52:51.465ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
75872024-11-07T22:52:51.465ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75882024-11-07T22:52:51.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75892024-11-07T22:52:51.472ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75902024-11-07T22:52:51.476ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
75912024-11-07T22:52:51.476ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75922024-11-07T22:52:51.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75932024-11-07T22:52:51.477ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
75942024-11-07T22:52:51.477ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "362ea324-dd19-48d5-88c6-e225b8041dfa", "content-length": "134", "date": "Thu, 07 Nov 2024 22:52:50 GMT"} })
75952024-11-07T22:52:51.477ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
75962024-11-07T22:52:51.477ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
75972024-11-07T22:52:51.477ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
75982024-11-07T22:52:51.477ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
75992024-11-07T22:52:51.477ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76002024-11-07T22:52:51.477ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76012024-11-07T22:52:51.477ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76022024-11-07T22:52:51.477ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76032024-11-07T22:52:51.478ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76042024-11-07T22:52:51.478ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76052024-11-07T22:52:51.478ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
76062024-11-07T22:52:51.478ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76072024-11-07T22:52:51.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76082024-11-07T22:52:51.481ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
76092024-11-07T22:52:51.482ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "da5684ad-4146-4ebf-a906-ba6081d7b0c5", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
76102024-11-07T22:52:51.482ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
76112024-11-07T22:52:51.483ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5514720b-ecd9-47ac-888d-efbd8d732424", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
76122024-11-07T22:52:51.483ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
76132024-11-07T22:52:51.485ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4103844e-e4b8-4b68-82d1-44c5b6f6ad3d", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
76142024-11-07T22:52:51.485ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
76152024-11-07T22:52:51.487ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
76162024-11-07T22:52:51.487ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 668.764906ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
76172024-11-07T22:52:51.491ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 672.326662ms iteration = 21 status = {}
76182024-11-07T22:52:51.529ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
76192024-11-07T22:52:51.529ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
76202024-11-07T22:52:51.532ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
76212024-11-07T22:52:51.532ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2783e8e7-8190-42dc-8a55-9e2a52640796", "content-length": "2", "date": "Thu, 07 Nov 2024 22:52:50 GMT"} })
76222024-11-07T22:52:51.532ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
76232024-11-07T22:52:51.532ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7082c4e0-f832-48d5-bf43-bcee80213088", "content-length": "52", "date": "Thu, 07 Nov 2024 22:52:50 GMT"} })
76242024-11-07T22:52:51.532ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
76252024-11-07T22:52:51.532ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
76262024-11-07T22:52:51.533ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76272024-11-07T22:52:51.534ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
76282024-11-07T22:52:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76292024-11-07T22:52:51.536ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76302024-11-07T22:52:51.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76312024-11-07T22:52:51.538ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76322024-11-07T22:52:51.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76332024-11-07T22:52:51.540ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76342024-11-07T22:52:51.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76352024-11-07T22:52:51.542ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76362024-11-07T22:52:51.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76372024-11-07T22:52:51.544ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76382024-11-07T22:52:51.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76392024-11-07T22:52:51.545ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76402024-11-07T22:52:51.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76412024-11-07T22:52:51.547ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76422024-11-07T22:52:51.551ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
76432024-11-07T22:52:51.551ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76442024-11-07T22:52:51.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76452024-11-07T22:52:51.553ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76462024-11-07T22:52:51.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76472024-11-07T22:52:51.554ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76482024-11-07T22:52:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76492024-11-07T22:52:51.556ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76502024-11-07T22:52:51.562ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
76512024-11-07T22:52:51.563ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76522024-11-07T22:52:51.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76532024-11-07T22:52:51.569ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 2dd87331-1080-4a71-a905-3e46ecebaf6c, kind: Service { id: 377e4941-a34d-4c51-b725-3cc833f8df14 }, name: Name("nexus-377e4941-a34d-4c51-b725-3cc833f8df14"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 64ed67c2-1a18-431c-8723-5c0738c08c4e, kind: Service { id: a5da1467-f0f3-4c0d-ad94-ed83c65ca978 }, name: Name("nexus-a5da1467-f0f3-4c0d-ad94-ed83c65ca978"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 89])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8a3c0e3f-1bcc-4caf-a59c-866543a0723e, kind: Service { id: 42e8095c-4973-40db-9d13-0be7e130d89d }, name: Name("nexus-42e8095c-4973-40db-9d13-0be7e130d89d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 45b10ace-97a4-4ae9-b37f-3abfe43591bc, kind: Service { id: 19da6a5b-073a-4e12-8775-91fc61c1e962 }, name: Name("external-dns-19da6a5b-073a-4e12-8775-91fc61c1e962"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 180])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7461ea38-345b-4151-b71f-10e7e61b2bc4, kind: Service { id: 939b4884-df0a-49e9-b0e5-27de78137ddd }, name: Name("external-dns-939b4884-df0a-49e9-b0e5-27de78137ddd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 151])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
76542024-11-07T22:52:51.569ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76552024-11-07T22:52:51.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76562024-11-07T22:52:51.571ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76572024-11-07T22:52:51.573ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
76582024-11-07T22:52:51.573ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76592024-11-07T22:52:51.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76602024-11-07T22:52:51.574ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
76612024-11-07T22:52:51.575ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 45b10ace-97a4-4ae9-b37f-3abfe43591bc, kind: Service { id: 19da6a5b-073a-4e12-8775-91fc61c1e962 }, name: Name("external-dns-19da6a5b-073a-4e12-8775-91fc61c1e962"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 180])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7461ea38-345b-4151-b71f-10e7e61b2bc4, kind: Service { id: 939b4884-df0a-49e9-b0e5-27de78137ddd }, name: Name("external-dns-939b4884-df0a-49e9-b0e5-27de78137ddd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 151])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2dd87331-1080-4a71-a905-3e46ecebaf6c, kind: Service { id: 377e4941-a34d-4c51-b725-3cc833f8df14 }, name: Name("nexus-377e4941-a34d-4c51-b725-3cc833f8df14"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 111])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 64ed67c2-1a18-431c-8723-5c0738c08c4e, kind: Service { id: a5da1467-f0f3-4c0d-ad94-ed83c65ca978 }, name: Name("nexus-a5da1467-f0f3-4c0d-ad94-ed83c65ca978"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 89])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8a3c0e3f-1bcc-4caf-a59c-866543a0723e, kind: Service { id: 42e8095c-4973-40db-9d13-0be7e130d89d }, name: Name("nexus-42e8095c-4973-40db-9d13-0be7e130d89d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
76622024-11-07T22:52:51.575ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
76632024-11-07T22:52:51.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8da6eb72-0d25-446a-abaa-eccb181e0374 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
76642024-11-07T22:52:51.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8da6eb72-0d25-446a-abaa-eccb181e0374 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
76652024-11-07T22:52:51.658ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "04061911-58ee-4db7-9f75-a2716011129d", "content-length": "691", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
76662024-11-07T22:52:51.658ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
76672024-11-07T22:52:51.658ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
76682024-11-07T22:52:51.658ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
76692024-11-07T22:52:51.660ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 841.63146ms iteration = 21 status = {}
76702024-11-07T22:52:51.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2892 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8da6eb72-0d25-446a-abaa-eccb181e0374 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
76712024-11-07T22:52:51.696ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, time_created: 2024-11-07T22:43:07.889510Z, time_modified: 2024-11-07T22:43:07.889510Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
76722024-11-07T22:52:51.696ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
76732024-11-07T22:52:51.696ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76742024-11-07T22:52:51.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76752024-11-07T22:52:51.699ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76762024-11-07T22:52:51.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76772024-11-07T22:52:51.701ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76782024-11-07T22:52:51.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
76792024-11-07T22:52:51.734ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
76802024-11-07T22:52:51.752ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "a414e755-2df8-4c82-b815-68739eac9e18", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
76812024-11-07T22:52:51.754ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
76822024-11-07T22:52:51.754ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 935.062021ms
76832024-11-07T22:52:51.754ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 935.071812ms iteration = 3 status = {}
76842024-11-07T22:52:51.790ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "791ae822-4faa-4bed-aeab-9c41d51c11b7", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
76852024-11-07T22:52:51.790ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
76862024-11-07T22:52:51.790ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
76872024-11-07T22:52:51.790ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "def70562-f492-41e7-9056-b395fe4bfd56", "content-length": "682", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
76882024-11-07T22:52:51.790ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76892024-11-07T22:52:51.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76902024-11-07T22:52:51.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76912024-11-07T22:52:51.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76922024-11-07T22:52:51.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76932024-11-07T22:52:51.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76942024-11-07T22:52:51.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76952024-11-07T22:52:51.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76962024-11-07T22:52:51.809ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 990.316213ms iteration = 21 status = {}
76972024-11-07T22:52:51.951ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "546d4cda-99f0-48d4-9d7b-92b6a4d62c9c", "content-length": "29193", "date": "Thu, 07 Nov 2024 22:52:51 GMT"} })
76982024-11-07T22:52:51.955ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
76992024-11-07T22:52:51.956ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
77002024-11-07T22:52:51.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
77012024-11-07T22:52:51.958ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77022024-11-07T22:52:51.961ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
77032024-11-07T22:52:51.961ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
77042024-11-07T22:52:51.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
77052024-11-07T22:52:51.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = c55f7603-7680-40ad-9816-fd5836c9bffa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
77062024-11-07T22:52:51.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = c55f7603-7680-40ad-9816-fd5836c9bffa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
77072024-11-07T22:52:51.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = c55f7603-7680-40ad-9816-fd5836c9bffa response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
77082024-11-07T22:52:52.127ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 51dc16a1-db5c-47d0-a36c-0641ecb06526 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
77092024-11-07T22:52:52.128ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 51dc16a1-db5c-47d0-a36c-0641ecb06526 time_started = 2024-11-07 22:52:51.181110 UTC
77102024-11-07T22:52:52.128ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.308986791s iteration = 4 status = {"collection_id":"51dc16a1-db5c-47d0-a36c-0641ecb06526","time_done":"2024-11-07 22:52:51.954884 UTC","time_started":"2024-11-07 22:52:51.181110 UTC"}
77112024-11-07T22:52:52.128ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
77122024-11-07T22:52:52.128ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77132024-11-07T22:52:52.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77142024-11-07T22:52:52.129ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77152024-11-07T22:52:52.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77162024-11-07T22:52:52.131ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77172024-11-07T22:52:52.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77182024-11-07T22:52:52.134ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77192024-11-07T22:52:52.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77202024-11-07T22:52:52.136ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77212024-11-07T22:52:52.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77222024-11-07T22:52:52.138ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77232024-11-07T22:52:52.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77242024-11-07T22:52:52.159ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 31.554041ms iteration = 25 status = {"physical_disks_added":0}
77252024-11-07T22:52:52.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 744e2514-6ff0-455b-aa3a-65e909b880a6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77262024-11-07T22:52:52.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 744e2514-6ff0-455b-aa3a-65e909b880a6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77272024-11-07T22:52:52.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2608 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 744e2514-6ff0-455b-aa3a-65e909b880a6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77282024-11-07T22:52:53.292ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:33705
77292024-11-07T22:52:53.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33705 req_id = 8094a94e-5950-41e9-9dbd-7d3428292c46 roles = RoleSet { roles: {} } uri = /metrics/producers
77302024-11-07T22:52:53.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33705 req_id = 8094a94e-5950-41e9-9dbd-7d3428292c46 resource = Database result = Ok(()) uri = /metrics/producers
77312024-11-07T22:52:53.336ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77322024-11-07T22:52:53.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44034 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33705 req_id = 8094a94e-5950-41e9-9dbd-7d3428292c46 response_code = 201 uri = /metrics/producers
77332024-11-07T22:52:53.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ce0476eb-1841-4dc1-aed7-d636243be66b roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77342024-11-07T22:52:53.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ce0476eb-1841-4dc1-aed7-d636243be66b resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77352024-11-07T22:52:53.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ce0476eb-1841-4dc1-aed7-d636243be66b response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77362024-11-07T22:52:54.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 59d19bd3-5c5d-4831-92b2-374c2de45311 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77372024-11-07T22:52:54.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 59d19bd3-5c5d-4831-92b2-374c2de45311 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77382024-11-07T22:52:54.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1797 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 59d19bd3-5c5d-4831-92b2-374c2de45311 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77392024-11-07T22:52:55.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4c09e64f-bdfe-4c32-899c-1632edbe7050 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77402024-11-07T22:52:55.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4c09e64f-bdfe-4c32-899c-1632edbe7050 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77412024-11-07T22:52:55.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4c09e64f-bdfe-4c32-899c-1632edbe7050 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77422024-11-07T22:52:56.342ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:51100
77432024-11-07T22:52:56.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51100 req_id = c2a9c9c4-fbec-43e6-a1b1-bfc44b5a6c36 roles = RoleSet { roles: {} } uri = /metrics/producers
77442024-11-07T22:52:56.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51100 req_id = c2a9c9c4-fbec-43e6-a1b1-bfc44b5a6c36 resource = Database result = Ok(()) uri = /metrics/producers
77452024-11-07T22:52:56.382ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 9e471274-19dd-4f92-b383-47c4daa65273
77462024-11-07T22:52:56.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39996 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51100 req_id = c2a9c9c4-fbec-43e6-a1b1-bfc44b5a6c36 response_code = 201 uri = /metrics/producers
77472024-11-07T22:52:56.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0e639dea-7f25-403e-9020-8290df3bcc86 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77482024-11-07T22:52:56.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0e639dea-7f25-403e-9020-8290df3bcc86 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77492024-11-07T22:52:56.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0e639dea-7f25-403e-9020-8290df3bcc86 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77502024-11-07T22:52:57.708ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:46850
77512024-11-07T22:52:57.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46850 req_id = 58c4a86c-3d1b-4ce9-9660-b3a1671162e9 roles = RoleSet { roles: {} } uri = /metrics/producers
77522024-11-07T22:52:57.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46850 req_id = 58c4a86c-3d1b-4ce9-9660-b3a1671162e9 resource = Database result = Ok(()) uri = /metrics/producers
77532024-11-07T22:52:57.758ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 815e7211-42cf-4415-8116-29d4376e1760
77542024-11-07T22:52:57.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50242 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46850 req_id = 58c4a86c-3d1b-4ce9-9660-b3a1671162e9 response_code = 201 uri = /metrics/producers
77552024-11-07T22:52:57.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 931beaec-8f83-4a94-87b1-f84bd35e36d1 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77562024-11-07T22:52:57.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 931beaec-8f83-4a94-87b1-f84bd35e36d1 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77572024-11-07T22:52:57.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 931beaec-8f83-4a94-87b1-f84bd35e36d1 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77582024-11-07T22:52:58.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b675421c-a461-4220-ad32-44889b63a336 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77592024-11-07T22:52:58.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b675421c-a461-4220-ad32-44889b63a336 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77602024-11-07T22:52:58.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1897 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b675421c-a461-4220-ad32-44889b63a336 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77612024-11-07T22:52:59.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7474180c-ecd0-4e41-b405-cea2c38024b6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77622024-11-07T22:52:59.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7474180c-ecd0-4e41-b405-cea2c38024b6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77632024-11-07T22:52:59.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7474180c-ecd0-4e41-b405-cea2c38024b6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77642024-11-07T22:53:00.023ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:59227
77652024-11-07T22:53:00.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59227 req_id = 153d6cac-37ca-4b3f-ad35-e7d5926ee75c roles = RoleSet { roles: {} } uri = /metrics/producers
77662024-11-07T22:53:00.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59227 req_id = 153d6cac-37ca-4b3f-ad35-e7d5926ee75c resource = Database result = Ok(()) uri = /metrics/producers
77672024-11-07T22:53:00.036ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 43a27374-6630-4b8d-a3e3-a2857df923bd
77682024-11-07T22:53:00.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 13263 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59227 req_id = 153d6cac-37ca-4b3f-ad35-e7d5926ee75c response_code = 201 uri = /metrics/producers
77692024-11-07T22:53:00.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
77702024-11-07T22:53:00.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
77712024-11-07T22:53:00.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77722024-11-07T22:53:00.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77732024-11-07T22:53:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77742024-11-07T22:53:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77752024-11-07T22:53:00.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77762024-11-07T22:53:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77772024-11-07T22:53:00.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77782024-11-07T22:53:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77792024-11-07T22:53:00.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77802024-11-07T22:53:00.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77812024-11-07T22:53:00.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77822024-11-07T22:53:00.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
77832024-11-07T22:53:00.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77842024-11-07T22:53:00.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77852024-11-07T22:53:00.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
77862024-11-07T22:53:00.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.805912ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
77872024-11-07T22:53:00.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77882024-11-07T22:53:00.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77892024-11-07T22:53:00.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.03878ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77902024-11-07T22:53:00.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = eed609da-ce33-4365-b5ab-66bc9fdc2e9c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77912024-11-07T22:53:00.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = eed609da-ce33-4365-b5ab-66bc9fdc2e9c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77922024-11-07T22:53:00.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = eed609da-ce33-4365-b5ab-66bc9fdc2e9c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77932024-11-07T22:53:01.673ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1352 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 96f5fa26-3d2d-4ccb-80df-ef5c92a390ea response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
77942024-11-07T22:53:01.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 28a8719e-027e-48d4-8a73-f8d864a84b9c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77952024-11-07T22:53:01.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 28a8719e-027e-48d4-8a73-f8d864a84b9c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77962024-11-07T22:53:01.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 28a8719e-027e-48d4-8a73-f8d864a84b9c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77972024-11-07T22:53:02.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 70b9ec75-3331-4f5b-b876-e01d8bbe4a07 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77982024-11-07T22:53:02.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 70b9ec75-3331-4f5b-b876-e01d8bbe4a07 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
77992024-11-07T22:53:02.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 70b9ec75-3331-4f5b-b876-e01d8bbe4a07 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78002024-11-07T22:53:03.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = da55b3db-fe62-449f-8a8b-61a048d1fae6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78012024-11-07T22:53:03.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = da55b3db-fe62-449f-8a8b-61a048d1fae6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78022024-11-07T22:53:03.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = da55b3db-fe62-449f-8a8b-61a048d1fae6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78032024-11-07T22:53:04.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cb5e1263-be14-499a-ac5b-52af9cbfaf16 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78042024-11-07T22:53:04.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cb5e1263-be14-499a-ac5b-52af9cbfaf16 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78052024-11-07T22:53:04.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cb5e1263-be14-499a-ac5b-52af9cbfaf16 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78062024-11-07T22:53:05.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 53f48911-edf2-4dd1-91ca-2ad3f1e77fdd roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78072024-11-07T22:53:05.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 53f48911-edf2-4dd1-91ca-2ad3f1e77fdd resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78082024-11-07T22:53:05.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 53f48911-edf2-4dd1-91ca-2ad3f1e77fdd response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78092024-11-07T22:53:06.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = b0f5afa3-438b-4564-a830-bb122d816370 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
78102024-11-07T22:53:06.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = b0f5afa3-438b-4564-a830-bb122d816370 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
78112024-11-07T22:53:06.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = b0f5afa3-438b-4564-a830-bb122d816370 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
78122024-11-07T22:53:06.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 67efd105-9f5d-4b3b-a118-1cc7ec1af6b7 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
78132024-11-07T22:53:06.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 67efd105-9f5d-4b3b-a118-1cc7ec1af6b7 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
78142024-11-07T22:53:06.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2716 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 67efd105-9f5d-4b3b-a118-1cc7ec1af6b7 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
78152024-11-07T22:53:07.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2d0b2f37-958c-4fc4-a463-a86d1d431985 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78162024-11-07T22:53:07.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2d0b2f37-958c-4fc4-a463-a86d1d431985 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78172024-11-07T22:53:07.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2d0b2f37-958c-4fc4-a463-a86d1d431985 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78182024-11-07T22:53:08.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d026491b-1777-4c45-bddd-740da983c450 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78192024-11-07T22:53:08.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d026491b-1777-4c45-bddd-740da983c450 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78202024-11-07T22:53:08.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2906 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d026491b-1777-4c45-bddd-740da983c450 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78212024-11-07T22:53:09.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e46813a9-94d0-4ed0-a9ed-1a9710617548 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78222024-11-07T22:53:09.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e46813a9-94d0-4ed0-a9ed-1a9710617548 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78232024-11-07T22:53:09.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e46813a9-94d0-4ed0-a9ed-1a9710617548 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78242024-11-07T22:53:10.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 28358cca-c1f1-46be-bde8-d9e414c2c302 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78252024-11-07T22:53:10.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 28358cca-c1f1-46be-bde8-d9e414c2c302 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78262024-11-07T22:53:10.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 28358cca-c1f1-46be-bde8-d9e414c2c302 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78272024-11-07T22:53:10.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
78282024-11-07T22:53:10.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
78292024-11-07T22:53:10.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78302024-11-07T22:53:10.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78312024-11-07T22:53:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78322024-11-07T22:53:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78332024-11-07T22:53:10.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78342024-11-07T22:53:10.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78352024-11-07T22:53:10.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78362024-11-07T22:53:10.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78372024-11-07T22:53:10.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78382024-11-07T22:53:10.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78392024-11-07T22:53:10.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78402024-11-07T22:53:10.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
78412024-11-07T22:53:10.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78422024-11-07T22:53:10.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78432024-11-07T22:53:10.840ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
78442024-11-07T22:53:10.840ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.621474ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
78452024-11-07T22:53:10.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78462024-11-07T22:53:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78472024-11-07T22:53:10.883ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.601823ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78482024-11-07T22:53:11.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e8b9a5a0-2f87-41f4-ac73-6f5c70d215de roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78492024-11-07T22:53:11.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e8b9a5a0-2f87-41f4-ac73-6f5c70d215de resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78502024-11-07T22:53:11.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e8b9a5a0-2f87-41f4-ac73-6f5c70d215de response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78512024-11-07T22:53:12.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fc2aded1-a0ee-4bc7-bab8-1fee4c271841 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78522024-11-07T22:53:12.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fc2aded1-a0ee-4bc7-bab8-1fee4c271841 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78532024-11-07T22:53:12.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fc2aded1-a0ee-4bc7-bab8-1fee4c271841 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78542024-11-07T22:53:12.810ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
78552024-11-07T22:53:12.810ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
78562024-11-07T22:53:12.840ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
78572024-11-07T22:53:12.840ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:52179
78582024-11-07T22:53:12.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:52179 req_id = ef01cd6e-5b7c-450f-9a9b-4d14e91c43f4 roles = RoleSet { roles: {} } uri = /metrics/producers
78592024-11-07T22:53:12.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:52179 req_id = ef01cd6e-5b7c-450f-9a9b-4d14e91c43f4 resource = Database result = Ok(()) uri = /metrics/producers
78602024-11-07T22:53:12.883ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 377e4941-a34d-4c51-b725-3cc833f8df14
78612024-11-07T22:53:12.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43675 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:52179 req_id = ef01cd6e-5b7c-450f-9a9b-4d14e91c43f4 response_code = 201 uri = /metrics/producers
78622024-11-07T22:53:12.884ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "ef01cd6e-5b7c-450f-9a9b-4d14e91c43f4", "content-length": "41", "date": "Thu, 07 Nov 2024 22:53:12 GMT"} })
78632024-11-07T22:53:12.885ZDEBGnexus (producer-registration-task): registered with nexus successfully
78642024-11-07T22:53:12.885ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
78652024-11-07T22:53:13.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ca465b12-7079-41ba-86e1-2e6f9649da23 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78662024-11-07T22:53:13.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ca465b12-7079-41ba-86e1-2e6f9649da23 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78672024-11-07T22:53:13.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ca465b12-7079-41ba-86e1-2e6f9649da23 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78682024-11-07T22:53:14.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e11812e7-af4d-4d6a-9c21-a3241634304b roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78692024-11-07T22:53:14.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e11812e7-af4d-4d6a-9c21-a3241634304b resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78702024-11-07T22:53:14.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e11812e7-af4d-4d6a-9c21-a3241634304b response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78712024-11-07T22:53:15.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1c9fe567-5fd6-488d-9f05-6753ba2fe01e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78722024-11-07T22:53:15.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1c9fe567-5fd6-488d-9f05-6753ba2fe01e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78732024-11-07T22:53:15.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1c9fe567-5fd6-488d-9f05-6753ba2fe01e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78742024-11-07T22:53:16.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2d4eb8bc-22e2-411b-b7df-124609e291c4 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78752024-11-07T22:53:16.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2d4eb8bc-22e2-411b-b7df-124609e291c4 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78762024-11-07T22:53:16.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2d4eb8bc-22e2-411b-b7df-124609e291c4 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78772024-11-07T22:53:16.654ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1791 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 22ea2b38-b638-43a2-bc0a-0f327886421f response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
78782024-11-07T22:53:17.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 04a833a8-0afc-4451-9e6a-c98759f8e1bd roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78792024-11-07T22:53:17.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 04a833a8-0afc-4451-9e6a-c98759f8e1bd resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78802024-11-07T22:53:17.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 04a833a8-0afc-4451-9e6a-c98759f8e1bd response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78812024-11-07T22:53:18.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 53a788f9-39c6-4bc4-bec5-56bae62f2e86 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78822024-11-07T22:53:18.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 53a788f9-39c6-4bc4-bec5-56bae62f2e86 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78832024-11-07T22:53:18.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1966 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 53a788f9-39c6-4bc4-bec5-56bae62f2e86 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78842024-11-07T22:53:19.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = de9c70cb-41bb-47e2-a6de-2ad9fef7cb28 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78852024-11-07T22:53:19.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = de9c70cb-41bb-47e2-a6de-2ad9fef7cb28 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78862024-11-07T22:53:19.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = de9c70cb-41bb-47e2-a6de-2ad9fef7cb28 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78872024-11-07T22:53:20.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 235399e7-812b-40e6-9d28-9bed5d3d6906 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78882024-11-07T22:53:20.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 235399e7-812b-40e6-9d28-9bed5d3d6906 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78892024-11-07T22:53:20.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 235399e7-812b-40e6-9d28-9bed5d3d6906 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
78902024-11-07T22:53:20.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
78912024-11-07T22:53:20.818ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
78922024-11-07T22:53:20.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78932024-11-07T22:53:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
78942024-11-07T22:53:20.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78952024-11-07T22:53:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
78962024-11-07T22:53:20.818ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
78972024-11-07T22:53:20.818ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
78982024-11-07T22:53:20.818ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
78992024-11-07T22:53:20.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79002024-11-07T22:53:20.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79012024-11-07T22:53:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
79022024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79032024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
79042024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79052024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
79062024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79072024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
79082024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
79092024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
79102024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79112024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
79122024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79132024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
79142024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
79152024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
79162024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79172024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
79182024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79192024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79202024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
79212024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
79222024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
79232024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79242024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
79252024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79262024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79272024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79282024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79292024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79302024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79312024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79322024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79332024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79342024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
79352024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79362024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
79372024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79382024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
79392024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79402024-11-07T22:53:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79412024-11-07T22:53:20.820ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79422024-11-07T22:53:20.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79432024-11-07T22:53:20.821ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79442024-11-07T22:53:20.822ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.96436ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
79452024-11-07T22:53:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
79462024-11-07T22:53:20.824ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79472024-11-07T22:53:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79482024-11-07T22:53:20.824ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79492024-11-07T22:53:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79502024-11-07T22:53:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79512024-11-07T22:53:20.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79522024-11-07T22:53:20.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79532024-11-07T22:53:20.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79542024-11-07T22:53:20.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79552024-11-07T22:53:20.828ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1294, tv_nsec: 917975956 } })
79562024-11-07T22:53:20.829ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
79572024-11-07T22:53:20.830ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1294, tv_nsec: 919357003 } })
79582024-11-07T22:53:20.830ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
79592024-11-07T22:53:20.831ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79602024-11-07T22:53:20.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79612024-11-07T22:53:20.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79622024-11-07T22:53:20.833ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79632024-11-07T22:53:20.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79642024-11-07T22:53:20.834ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79652024-11-07T22:53:20.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79662024-11-07T22:53:20.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79672024-11-07T22:53:20.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79682024-11-07T22:53:20.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79692024-11-07T22:53:20.835ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79702024-11-07T22:53:20.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79712024-11-07T22:53:20.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79722024-11-07T22:53:20.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79732024-11-07T22:53:20.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
79742024-11-07T22:53:20.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79752024-11-07T22:53:20.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79762024-11-07T22:53:20.854ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
79772024-11-07T22:53:20.854ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.302343ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
79782024-11-07T22:53:20.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.70747ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
79792024-11-07T22:53:20.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.968092ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
79802024-11-07T22:53:20.870ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79812024-11-07T22:53:20.870ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79822024-11-07T22:53:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79832024-11-07T22:53:20.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79842024-11-07T22:53:20.871ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79852024-11-07T22:53:20.875ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79862024-11-07T22:53:20.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
79872024-11-07T22:53:20.875ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79882024-11-07T22:53:20.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79892024-11-07T22:53:20.880ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79902024-11-07T22:53:20.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79912024-11-07T22:53:20.880ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79922024-11-07T22:53:20.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79932024-11-07T22:53:20.881ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79942024-11-07T22:53:20.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79952024-11-07T22:53:20.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
79962024-11-07T22:53:20.881ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79972024-11-07T22:53:20.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79982024-11-07T22:53:20.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79992024-11-07T22:53:20.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80002024-11-07T22:53:20.884ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80012024-11-07T22:53:20.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80022024-11-07T22:53:20.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80032024-11-07T22:53:20.886ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80042024-11-07T22:53:20.886ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
80052024-11-07T22:53:20.886ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80062024-11-07T22:53:20.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80072024-11-07T22:53:20.887ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1294, tv_nsec: 976790603 } })
80082024-11-07T22:53:20.887ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80092024-11-07T22:53:20.887ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80102024-11-07T22:53:20.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80112024-11-07T22:53:20.887ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
80122024-11-07T22:53:20.888ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80132024-11-07T22:53:20.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
80142024-11-07T22:53:20.891ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80152024-11-07T22:53:20.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80162024-11-07T22:53:20.894ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 75.455546ms iteration = 22 status = 0
80172024-11-07T22:53:20.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 100.291797ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
80182024-11-07T22:53:20.923ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80192024-11-07T22:53:20.924ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
80202024-11-07T22:53:20.924ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80212024-11-07T22:53:20.924ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 105.351753ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
80222024-11-07T22:53:20.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80232024-11-07T22:53:20.926ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 107.050649ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80242024-11-07T22:53:20.931ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
80252024-11-07T22:53:20.931ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 112.124135ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
80262024-11-07T22:53:20.935ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 116.948986ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80272024-11-07T22:53:20.968ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80282024-11-07T22:53:20.968ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
80292024-11-07T22:53:20.968ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 149.33278ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
80302024-11-07T22:53:20.993ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80312024-11-07T22:53:20.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80322024-11-07T22:53:20.995ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 176.201755ms iteration = 26 status = {"physical_disks_added":0}
80332024-11-07T22:53:21.000ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
80342024-11-07T22:53:21.000ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80352024-11-07T22:53:21.000ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3636c06e-f412-4b1b-8cca-26c75228c7a3", "content-length": "26", "date": "Thu, 07 Nov 2024 22:53:20 GMT"} })
80362024-11-07T22:53:21.000ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80372024-11-07T22:53:21.002ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
80382024-11-07T22:53:21.004ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80392024-11-07T22:53:21.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80402024-11-07T22:53:21.006ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80412024-11-07T22:53:21.010ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80422024-11-07T22:53:21.010ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80432024-11-07T22:53:21.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80442024-11-07T22:53:21.021ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
80452024-11-07T22:53:21.021ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80462024-11-07T22:53:21.022ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1dcb527-641d-4cd1-baf1-64c9ca315a80", "content-length": "26", "date": "Thu, 07 Nov 2024 22:53:20 GMT"} })
80472024-11-07T22:53:21.022ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80482024-11-07T22:53:21.023ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80492024-11-07T22:53:21.051ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
80502024-11-07T22:53:21.051ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80512024-11-07T22:53:21.052ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d486a4f-edb8-4ad3-9a8e-3c2ddf618fa5", "content-length": "26", "date": "Thu, 07 Nov 2024 22:53:20 GMT"} })
80522024-11-07T22:53:21.052ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80532024-11-07T22:53:21.054ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80542024-11-07T22:53:21.087ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
80552024-11-07T22:53:21.087ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80562024-11-07T22:53:21.089ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ba7b1aa-0315-4d1d-8d96-8ce36143c5b5", "content-length": "372", "date": "Thu, 07 Nov 2024 22:53:21 GMT"} })
80572024-11-07T22:53:21.089ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80582024-11-07T22:53:21.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80592024-11-07T22:53:21.108ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
80602024-11-07T22:53:21.108ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
80612024-11-07T22:53:21.108ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7126eac1-75af-4c50-8398-35659c538ecd", "date": "Thu, 07 Nov 2024 22:53:21 GMT"} })
80622024-11-07T22:53:21.108ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80632024-11-07T22:53:21.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80642024-11-07T22:53:21.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80652024-11-07T22:53:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80662024-11-07T22:53:21.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80672024-11-07T22:53:21.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80682024-11-07T22:53:21.119ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
80692024-11-07T22:53:21.119ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80702024-11-07T22:53:21.119ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f20341c0-6ab6-4732-940e-28212065712f", "date": "Thu, 07 Nov 2024 22:53:21 GMT"} })
80712024-11-07T22:53:21.121ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 302.741489ms iteration = 23 status = {}
80722024-11-07T22:53:21.125ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80732024-11-07T22:53:21.127ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80742024-11-07T22:53:21.127ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80752024-11-07T22:53:21.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80762024-11-07T22:53:21.139ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
80772024-11-07T22:53:21.140ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a24a09b-e1d7-421f-9457-e4278d0a308b", "content-length": "1", "date": "Thu, 07 Nov 2024 22:53:20 GMT"} })
80782024-11-07T22:53:21.141ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80792024-11-07T22:53:21.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80802024-11-07T22:53:21.143ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 324.162278ms iteration = 22 status = null
80812024-11-07T22:53:21.155ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 336.50679ms iteration = 22 status = {}
80822024-11-07T22:53:21.207ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
80832024-11-07T22:53:21.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80842024-11-07T22:53:21.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80852024-11-07T22:53:21.239ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
80862024-11-07T22:53:21.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80872024-11-07T22:53:21.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80882024-11-07T22:53:21.249ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
80892024-11-07T22:53:21.250ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e077d83-f0ce-4003-991f-9fab6622e52e", "content-length": "134", "date": "Thu, 07 Nov 2024 22:53:20 GMT"} })
80902024-11-07T22:53:21.250ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
80912024-11-07T22:53:21.250ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
80922024-11-07T22:53:21.250ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
80932024-11-07T22:53:21.250ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
80942024-11-07T22:53:21.250ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80952024-11-07T22:53:21.250ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80962024-11-07T22:53:21.250ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80972024-11-07T22:53:21.250ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80982024-11-07T22:53:21.250ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80992024-11-07T22:53:21.250ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81002024-11-07T22:53:21.250ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
81012024-11-07T22:53:21.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81022024-11-07T22:53:21.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81032024-11-07T22:53:21.252ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
81042024-11-07T22:53:21.252ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "efabe139-5d6e-4154-b988-5503ea1e66ca", "content-length": "2", "date": "Thu, 07 Nov 2024 22:53:20 GMT"} })
81052024-11-07T22:53:21.252ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
81062024-11-07T22:53:21.252ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "65840521-75fc-4d89-ab60-36e7bc5c4609", "content-length": "52", "date": "Thu, 07 Nov 2024 22:53:20 GMT"} })
81072024-11-07T22:53:21.252ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
81082024-11-07T22:53:21.252ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
81092024-11-07T22:53:21.305ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "67b8dbbc-86bb-4947-b1b0-025d4c91c0d8", "content-length": "691", "date": "Thu, 07 Nov 2024 22:53:21 GMT"} })
81102024-11-07T22:53:21.305ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
81112024-11-07T22:53:21.305ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
81122024-11-07T22:53:21.305ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
81132024-11-07T22:53:21.307ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 488.649886ms iteration = 22 status = {}
81142024-11-07T22:53:21.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8716f895-2fce-412c-9b6b-99cf674404f0 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81152024-11-07T22:53:21.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8716f895-2fce-412c-9b6b-99cf674404f0 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81162024-11-07T22:53:21.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1987 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8716f895-2fce-412c-9b6b-99cf674404f0 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81172024-11-07T22:53:21.504ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "282eec82-1703-49ba-8d45-5d840911a186", "date": "Thu, 07 Nov 2024 22:53:21 GMT"} })
81182024-11-07T22:53:21.504ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
81192024-11-07T22:53:21.504ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
81202024-11-07T22:53:21.504ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c9f2064-6efa-42c0-9752-324e379a86ea", "content-length": "682", "date": "Thu, 07 Nov 2024 22:53:21 GMT"} })
81212024-11-07T22:53:21.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81222024-11-07T22:53:21.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81232024-11-07T22:53:21.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81242024-11-07T22:53:21.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81252024-11-07T22:53:21.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81262024-11-07T22:53:21.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81272024-11-07T22:53:21.514ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81282024-11-07T22:53:21.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81292024-11-07T22:53:21.522ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 703.119443ms iteration = 22 status = {}
81302024-11-07T22:53:22.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = b5083b56-ee5e-4620-8777-4a74b95545b8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
81312024-11-07T22:53:22.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = b5083b56-ee5e-4620-8777-4a74b95545b8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
81322024-11-07T22:53:22.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = b5083b56-ee5e-4620-8777-4a74b95545b8 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
81332024-11-07T22:53:22.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a49a8720-3edd-4bec-ae33-dea0fde62c01 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81342024-11-07T22:53:22.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a49a8720-3edd-4bec-ae33-dea0fde62c01 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81352024-11-07T22:53:22.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a49a8720-3edd-4bec-ae33-dea0fde62c01 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81362024-11-07T22:53:23.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0598b3b3-ed40-43a3-8908-80950f7cd901 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81372024-11-07T22:53:23.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0598b3b3-ed40-43a3-8908-80950f7cd901 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81382024-11-07T22:53:23.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2436 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0598b3b3-ed40-43a3-8908-80950f7cd901 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81392024-11-07T22:53:24.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = aa22f77e-ffde-4c9a-b6c3-ae487a8d71d5 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81402024-11-07T22:53:24.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = aa22f77e-ffde-4c9a-b6c3-ae487a8d71d5 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81412024-11-07T22:53:24.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = aa22f77e-ffde-4c9a-b6c3-ae487a8d71d5 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81422024-11-07T22:53:25.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8a321b6b-8e25-4711-baec-a7213d912903 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81432024-11-07T22:53:25.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8a321b6b-8e25-4711-baec-a7213d912903 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81442024-11-07T22:53:25.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1813 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8a321b6b-8e25-4711-baec-a7213d912903 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81452024-11-07T22:53:26.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = aac34207-0525-4b3c-b5c9-d23301d14042 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81462024-11-07T22:53:26.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = aac34207-0525-4b3c-b5c9-d23301d14042 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81472024-11-07T22:53:26.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2368 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = aac34207-0525-4b3c-b5c9-d23301d14042 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81482024-11-07T22:53:27.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c1182e71-228e-41c5-9cd6-b6a37aa545fa roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81492024-11-07T22:53:27.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c1182e71-228e-41c5-9cd6-b6a37aa545fa resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81502024-11-07T22:53:27.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c1182e71-228e-41c5-9cd6-b6a37aa545fa response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81512024-11-07T22:53:28.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 20e87614-bc20-4135-91da-574e0292da2a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81522024-11-07T22:53:28.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 20e87614-bc20-4135-91da-574e0292da2a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81532024-11-07T22:53:28.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 20e87614-bc20-4135-91da-574e0292da2a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81542024-11-07T22:53:29.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 17a2b978-e0db-49d4-b26e-4e624fa588cb roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81552024-11-07T22:53:29.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 17a2b978-e0db-49d4-b26e-4e624fa588cb resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81562024-11-07T22:53:29.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2673 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 17a2b978-e0db-49d4-b26e-4e624fa588cb response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81572024-11-07T22:53:30.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 45201004-fdcb-4038-bbac-87079cd03cca roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81582024-11-07T22:53:30.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 45201004-fdcb-4038-bbac-87079cd03cca resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81592024-11-07T22:53:30.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1709 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 45201004-fdcb-4038-bbac-87079cd03cca response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81602024-11-07T22:53:30.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
81612024-11-07T22:53:30.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
81622024-11-07T22:53:30.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81632024-11-07T22:53:30.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81642024-11-07T22:53:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81652024-11-07T22:53:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81662024-11-07T22:53:30.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81672024-11-07T22:53:30.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81682024-11-07T22:53:30.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81692024-11-07T22:53:30.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81702024-11-07T22:53:30.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81712024-11-07T22:53:30.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81722024-11-07T22:53:30.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81732024-11-07T22:53:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
81742024-11-07T22:53:30.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81752024-11-07T22:53:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81762024-11-07T22:53:30.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
81772024-11-07T22:53:30.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.966507ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
81782024-11-07T22:53:30.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81792024-11-07T22:53:30.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81802024-11-07T22:53:30.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.214251ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81812024-11-07T22:53:31.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5cf4939d-c754-4a4c-a821-8f39341695ef roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81822024-11-07T22:53:31.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5cf4939d-c754-4a4c-a821-8f39341695ef resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81832024-11-07T22:53:31.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5cf4939d-c754-4a4c-a821-8f39341695ef response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81842024-11-07T22:53:31.654ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1452 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 4191d4ca-ce0f-47c8-a275-9786c94da8f5 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
81852024-11-07T22:53:32.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0e5c8ca1-7a33-4daf-bb4d-1b5af5efd1e5 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81862024-11-07T22:53:32.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0e5c8ca1-7a33-4daf-bb4d-1b5af5efd1e5 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81872024-11-07T22:53:32.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0e5c8ca1-7a33-4daf-bb4d-1b5af5efd1e5 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81882024-11-07T22:53:33.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d138e490-9716-4182-8d86-1f2649b2c7fa roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81892024-11-07T22:53:33.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d138e490-9716-4182-8d86-1f2649b2c7fa resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81902024-11-07T22:53:33.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2062 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d138e490-9716-4182-8d86-1f2649b2c7fa response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81912024-11-07T22:53:34.303ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:43280
81922024-11-07T22:53:34.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43280 req_id = e9a4b875-12ba-4989-8828-df9589673b85 roles = RoleSet { roles: {} } uri = /metrics/producers
81932024-11-07T22:53:34.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43280 req_id = e9a4b875-12ba-4989-8828-df9589673b85 resource = Database result = Ok(()) uri = /metrics/producers
81942024-11-07T22:53:34.315ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = e777764e-54ab-4a09-9e71-5c47b8b59e5e
81952024-11-07T22:53:34.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 12407 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43280 req_id = e9a4b875-12ba-4989-8828-df9589673b85 response_code = 201 uri = /metrics/producers
81962024-11-07T22:53:34.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3c94ea9e-5889-48fc-a91c-5d6480acfacc roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81972024-11-07T22:53:34.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3c94ea9e-5889-48fc-a91c-5d6480acfacc resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81982024-11-07T22:53:34.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3c94ea9e-5889-48fc-a91c-5d6480acfacc response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
81992024-11-07T22:53:35.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fe3f5424-b707-44f8-8917-d6b0267eb41c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82002024-11-07T22:53:35.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fe3f5424-b707-44f8-8917-d6b0267eb41c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82012024-11-07T22:53:35.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fe3f5424-b707-44f8-8917-d6b0267eb41c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82022024-11-07T22:53:35.734ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:47532
82032024-11-07T22:53:35.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47532 req_id = 0a3e9404-d546-481b-9eb5-7bcf32683030 roles = RoleSet { roles: {} } uri = /metrics/producers
82042024-11-07T22:53:35.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47532 req_id = 0a3e9404-d546-481b-9eb5-7bcf32683030 resource = Database result = Ok(()) uri = /metrics/producers
82052024-11-07T22:53:35.745ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 5fb8d961-b437-4fc7-94a2-b09d338a9d9d
82062024-11-07T22:53:35.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11253 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47532 req_id = 0a3e9404-d546-481b-9eb5-7bcf32683030 response_code = 201 uri = /metrics/producers
82072024-11-07T22:53:36.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 3aade2b3-0aed-4cfb-ae69-19788be11b9f roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
82082024-11-07T22:53:36.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 3aade2b3-0aed-4cfb-ae69-19788be11b9f resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
82092024-11-07T22:53:36.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3023 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 3aade2b3-0aed-4cfb-ae69-19788be11b9f response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
82102024-11-07T22:53:36.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = a725ee9f-b9c5-4f46-b047-8ec83af717ad roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
82112024-11-07T22:53:36.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = a725ee9f-b9c5-4f46-b047-8ec83af717ad resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
82122024-11-07T22:53:36.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2416 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = a725ee9f-b9c5-4f46-b047-8ec83af717ad response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
82132024-11-07T22:53:36.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 780dfd21-9c6c-43a7-b95c-756e12f41bce roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82142024-11-07T22:53:36.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 780dfd21-9c6c-43a7-b95c-756e12f41bce resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82152024-11-07T22:53:36.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 780dfd21-9c6c-43a7-b95c-756e12f41bce response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82162024-11-07T22:53:37.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e3b2309b-fdb3-4e78-92c8-7f1ca8fe6ee3 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82172024-11-07T22:53:37.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e3b2309b-fdb3-4e78-92c8-7f1ca8fe6ee3 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82182024-11-07T22:53:37.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e3b2309b-fdb3-4e78-92c8-7f1ca8fe6ee3 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82192024-11-07T22:53:38.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2312bd9e-323c-4e67-86bf-00e522e4f580 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82202024-11-07T22:53:38.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2312bd9e-323c-4e67-86bf-00e522e4f580 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82212024-11-07T22:53:38.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2312bd9e-323c-4e67-86bf-00e522e4f580 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82222024-11-07T22:53:39.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8ae2b119-3e86-4d95-90d4-b54a98424c8a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82232024-11-07T22:53:39.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8ae2b119-3e86-4d95-90d4-b54a98424c8a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82242024-11-07T22:53:39.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8ae2b119-3e86-4d95-90d4-b54a98424c8a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82252024-11-07T22:53:40.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ff796448-ce9a-46ac-b04e-19c9983a8d39 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82262024-11-07T22:53:40.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ff796448-ce9a-46ac-b04e-19c9983a8d39 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82272024-11-07T22:53:40.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1819 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ff796448-ce9a-46ac-b04e-19c9983a8d39 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82282024-11-07T22:53:40.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
82292024-11-07T22:53:40.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
82302024-11-07T22:53:40.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82312024-11-07T22:53:40.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82322024-11-07T22:53:40.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82332024-11-07T22:53:40.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82342024-11-07T22:53:40.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82352024-11-07T22:53:40.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82362024-11-07T22:53:40.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82372024-11-07T22:53:40.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.437759ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82382024-11-07T22:53:40.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82392024-11-07T22:53:40.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82402024-11-07T22:53:40.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82412024-11-07T22:53:40.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82422024-11-07T22:53:40.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82432024-11-07T22:53:40.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82442024-11-07T22:53:40.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
82452024-11-07T22:53:40.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82462024-11-07T22:53:40.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82472024-11-07T22:53:40.837ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
82482024-11-07T22:53:40.837ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.008963ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
82492024-11-07T22:53:41.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5c399cbd-c239-4604-a7cf-9b2235efdce3 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82502024-11-07T22:53:41.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5c399cbd-c239-4604-a7cf-9b2235efdce3 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82512024-11-07T22:53:41.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5c399cbd-c239-4604-a7cf-9b2235efdce3 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82522024-11-07T22:53:42.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bbf37008-07d6-4df2-91d6-e1dbebf29094 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82532024-11-07T22:53:42.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bbf37008-07d6-4df2-91d6-e1dbebf29094 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82542024-11-07T22:53:42.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bbf37008-07d6-4df2-91d6-e1dbebf29094 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82552024-11-07T22:53:43.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 532dda30-2792-4fac-88f4-2a0c834181a3 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82562024-11-07T22:53:43.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 532dda30-2792-4fac-88f4-2a0c834181a3 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82572024-11-07T22:53:43.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1852 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 532dda30-2792-4fac-88f4-2a0c834181a3 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82582024-11-07T22:53:44.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f332d0a6-34ed-4f5e-bf10-ea72e0333405 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82592024-11-07T22:53:44.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f332d0a6-34ed-4f5e-bf10-ea72e0333405 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82602024-11-07T22:53:44.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f332d0a6-34ed-4f5e-bf10-ea72e0333405 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82612024-11-07T22:53:45.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2a722eef-4956-4274-8ad3-c16c122ecb52 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82622024-11-07T22:53:45.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2a722eef-4956-4274-8ad3-c16c122ecb52 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82632024-11-07T22:53:45.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2a722eef-4956-4274-8ad3-c16c122ecb52 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82642024-11-07T22:53:46.653ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1357 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 9fccaf72-778c-4114-accf-58b1d87cdcf8 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
82652024-11-07T22:53:46.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bfc84b38-6bbf-4995-9dfb-930c2ad7ce7f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82662024-11-07T22:53:46.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bfc84b38-6bbf-4995-9dfb-930c2ad7ce7f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82672024-11-07T22:53:46.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bfc84b38-6bbf-4995-9dfb-930c2ad7ce7f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82682024-11-07T22:53:47.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 86eb5118-ce60-4ead-9257-b73bd6036e62 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82692024-11-07T22:53:47.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 86eb5118-ce60-4ead-9257-b73bd6036e62 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82702024-11-07T22:53:47.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 86eb5118-ce60-4ead-9257-b73bd6036e62 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82712024-11-07T22:53:48.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1e4b058d-8228-4443-9f8e-bdf32fd207e7 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82722024-11-07T22:53:48.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1e4b058d-8228-4443-9f8e-bdf32fd207e7 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82732024-11-07T22:53:48.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1e4b058d-8228-4443-9f8e-bdf32fd207e7 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82742024-11-07T22:53:50.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ff56d630-255c-4083-b6f8-b7b619d5f9fd roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82752024-11-07T22:53:50.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ff56d630-255c-4083-b6f8-b7b619d5f9fd resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82762024-11-07T22:53:50.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ff56d630-255c-4083-b6f8-b7b619d5f9fd response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
82772024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
82782024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
82792024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82802024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
82812024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
82822024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
82832024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
82842024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
82852024-11-07T22:53:50.818ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-07 22:43:50.818607266 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
82862024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
82872024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
82882024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
82892024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
82902024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
82912024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
82922024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
82932024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82942024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
82952024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
82962024-11-07T22:53:50.818ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531
82972024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
82982024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.071\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531"}
82992024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
83002024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
83012024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
83022024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83032024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
83042024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
83052024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83062024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83072024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
83082024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83092024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
83102024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
83112024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83122024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
83132024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
83142024-11-07T22:53:50.818ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
83152024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
83162024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83172024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83182024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
83192024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83202024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
83212024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
83222024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
83232024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
83242024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83252024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
83262024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
83272024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
83282024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83292024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
83302024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
83312024-11-07T22:53:50.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83322024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
83332024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
83342024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83352024-11-07T22:53:50.819ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
83362024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
83372024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
83382024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83392024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83402024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83412024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
83422024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
83432024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83442024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
83452024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
83462024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
83472024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83482024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83492024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83502024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83512024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83522024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
83532024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83542024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83552024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83562024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83572024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83582024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83592024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
83602024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83612024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
83622024-11-07T22:53:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83632024-11-07T22:53:50.819ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19da6a5b-073a-4e12-8775-91fc61c1e962.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1324, tv_nsec: 908739477 } })
83642024-11-07T22:53:50.819ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a127151b-10b2-4835-91ce-b493ecd30481.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("de9282a1-0aa7-4ad8-a39a-58f19d05b651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1324, tv_nsec: 908763427 } })
83652024-11-07T22:53:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
83662024-11-07T22:53:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.137031ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
83672024-11-07T22:53:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
83682024-11-07T22:53:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.543391ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
83692024-11-07T22:53:50.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83702024-11-07T22:53:50.821ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.125645ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
83712024-11-07T22:53:50.822ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.399252ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
83722024-11-07T22:53:50.822ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-07 22:43:50.818607266 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
83732024-11-07T22:53:50.822ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.798712ms iteration = 12 status = {"expiration":"2024-11-07T22:43:50.818607266Z","pruned":[]}
83742024-11-07T22:53:50.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83752024-11-07T22:53:50.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83762024-11-07T22:53:50.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83772024-11-07T22:53:50.823ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83782024-11-07T22:53:50.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83792024-11-07T22:53:50.825ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.119642ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
83802024-11-07T22:53:50.826ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1324, tv_nsec: 915333165 } })
83812024-11-07T22:53:50.826ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83822024-11-07T22:53:50.826ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
83832024-11-07T22:53:50.826ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83842024-11-07T22:53:50.826ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83852024-11-07T22:53:50.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83862024-11-07T22:53:50.827ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
83872024-11-07T22:53:50.827ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
83882024-11-07T22:53:50.827ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1324, tv_nsec: 917085442 } })
83892024-11-07T22:53:50.827ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 9.196618ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
83902024-11-07T22:53:50.828ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
83912024-11-07T22:53:50.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
83922024-11-07T22:53:50.829ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83932024-11-07T22:53:50.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
83942024-11-07T22:53:50.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83952024-11-07T22:53:50.829ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83962024-11-07T22:53:50.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83972024-11-07T22:53:50.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83982024-11-07T22:53:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83992024-11-07T22:53:50.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84002024-11-07T22:53:50.831ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84012024-11-07T22:53:50.831ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
84022024-11-07T22:53:50.831ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84032024-11-07T22:53:50.832ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84042024-11-07T22:53:50.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84052024-11-07T22:53:50.832ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84062024-11-07T22:53:50.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84072024-11-07T22:53:50.833ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84082024-11-07T22:53:50.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84092024-11-07T22:53:50.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84102024-11-07T22:53:50.835ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84112024-11-07T22:53:50.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
84122024-11-07T22:53:50.835ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84132024-11-07T22:53:50.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84142024-11-07T22:53:50.836ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84152024-11-07T22:53:50.837ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
84162024-11-07T22:53:50.837ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84172024-11-07T22:53:50.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84182024-11-07T22:53:50.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
84192024-11-07T22:53:50.838ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
84202024-11-07T22:53:50.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
84212024-11-07T22:53:50.841ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84222024-11-07T22:53:50.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84232024-11-07T22:53:50.841ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1324, tv_nsec: 930014461 } })
84242024-11-07T22:53:50.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84252024-11-07T22:53:50.841ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
84262024-11-07T22:53:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84272024-11-07T22:53:50.847ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
84282024-11-07T22:53:50.847ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 28.491139ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
84292024-11-07T22:53:50.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84302024-11-07T22:53:50.848ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84312024-11-07T22:53:50.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84322024-11-07T22:53:50.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84332024-11-07T22:53:50.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84342024-11-07T22:53:50.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
84352024-11-07T22:53:50.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84362024-11-07T22:53:50.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84372024-11-07T22:53:50.854ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84382024-11-07T22:53:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
84392024-11-07T22:53:50.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84402024-11-07T22:53:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84412024-11-07T22:53:50.868ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84422024-11-07T22:53:50.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84432024-11-07T22:53:50.877ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
84442024-11-07T22:53:50.877ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 59.388863ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
84452024-11-07T22:53:50.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84462024-11-07T22:53:50.885ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84472024-11-07T22:53:50.886ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
84482024-11-07T22:53:50.886ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84492024-11-07T22:53:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84502024-11-07T22:53:50.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84512024-11-07T22:53:50.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84522024-11-07T22:53:50.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84532024-11-07T22:53:50.888ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84542024-11-07T22:53:50.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84552024-11-07T22:53:50.891ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.752033ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
84562024-11-07T22:53:50.892ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84572024-11-07T22:53:50.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84582024-11-07T22:53:50.898ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
84592024-11-07T22:53:50.898ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
84602024-11-07T22:53:50.898ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
84612024-11-07T22:53:50.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84622024-11-07T22:53:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84632024-11-07T22:53:50.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84642024-11-07T22:53:50.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84652024-11-07T22:53:50.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84662024-11-07T22:53:50.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84672024-11-07T22:53:50.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84682024-11-07T22:53:50.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84692024-11-07T22:53:50.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84702024-11-07T22:53:50.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84712024-11-07T22:53:50.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 84.820289ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
84722024-11-07T22:53:50.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84732024-11-07T22:53:50.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.430122ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84742024-11-07T22:53:50.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84752024-11-07T22:53:50.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84762024-11-07T22:53:50.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.056999ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84772024-11-07T22:53:50.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84782024-11-07T22:53:50.907ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84792024-11-07T22:53:50.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84802024-11-07T22:53:50.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84812024-11-07T22:53:50.908ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84822024-11-07T22:53:50.910ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84832024-11-07T22:53:50.911ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84842024-11-07T22:53:50.911ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84852024-11-07T22:53:50.911ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
84862024-11-07T22:53:50.911ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
84872024-11-07T22:53:50.911ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 92.780143ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
84882024-11-07T22:53:50.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84892024-11-07T22:53:50.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84902024-11-07T22:53:50.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84912024-11-07T22:53:50.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84922024-11-07T22:53:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
84932024-11-07T22:53:50.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84942024-11-07T22:53:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84952024-11-07T22:53:50.914ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84962024-11-07T22:53:50.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84972024-11-07T22:53:50.916ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84982024-11-07T22:53:50.917ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84992024-11-07T22:53:50.917ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.840687ms iteration = 23 status = 0
85002024-11-07T22:53:50.919ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85012024-11-07T22:53:50.919ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85022024-11-07T22:53:50.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85032024-11-07T22:53:50.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
85042024-11-07T22:53:50.921ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85052024-11-07T22:53:50.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85062024-11-07T22:53:50.945ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85072024-11-07T22:53:50.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85082024-11-07T22:53:50.950ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
85092024-11-07T22:53:50.950ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
85102024-11-07T22:53:50.950ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
85112024-11-07T22:53:50.950ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85122024-11-07T22:53:50.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85132024-11-07T22:53:50.952ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
85142024-11-07T22:53:50.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
85152024-11-07T22:53:50.953ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85162024-11-07T22:53:50.953ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85172024-11-07T22:53:50.953ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
85182024-11-07T22:53:50.953ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 134.711825ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
85192024-11-07T22:53:50.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85202024-11-07T22:53:50.956ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85212024-11-07T22:53:50.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85222024-11-07T22:53:50.969ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
85232024-11-07T22:53:50.969ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
85242024-11-07T22:53:50.969ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85252024-11-07T22:53:50.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85262024-11-07T22:53:51.008ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
85272024-11-07T22:53:51.008ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85282024-11-07T22:53:51.008ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
85292024-11-07T22:53:51.008ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdc08861-be39-4b35-8d35-3551ce82ebf2", "content-length": "26", "date": "Thu, 07 Nov 2024 22:53:51 GMT"} })
85302024-11-07T22:53:51.008ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85312024-11-07T22:53:51.011ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
85322024-11-07T22:53:51.023ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
85332024-11-07T22:53:51.024ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85342024-11-07T22:53:51.024ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "09914418-b177-4748-8076-14afb0ee13cf", "content-length": "26", "date": "Thu, 07 Nov 2024 22:53:51 GMT"} })
85352024-11-07T22:53:51.024ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85362024-11-07T22:53:51.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5051d5bc-d9fe-4838-8445-5c57f0ef304c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
85372024-11-07T22:53:51.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5051d5bc-d9fe-4838-8445-5c57f0ef304c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
85382024-11-07T22:53:51.039ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85392024-11-07T22:53:51.040ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
85402024-11-07T22:53:51.052ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
85412024-11-07T22:53:51.052ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85422024-11-07T22:53:51.052ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1514f241-ff6f-42a2-8e59-9cd9c4c38d81", "content-length": "26", "date": "Thu, 07 Nov 2024 22:53:51 GMT"} })
85432024-11-07T22:53:51.052ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85442024-11-07T22:53:51.055ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85452024-11-07T22:53:51.137ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
85462024-11-07T22:53:51.137ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "777f3087-6f06-4c83-96c1-750ff3e121ee", "content-length": "691", "date": "Thu, 07 Nov 2024 22:53:51 GMT"} })
85472024-11-07T22:53:51.137ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
85482024-11-07T22:53:51.137ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
85492024-11-07T22:53:51.137ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
85502024-11-07T22:53:51.139ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 320.598842ms iteration = 23 status = {}
85512024-11-07T22:53:51.149ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
85522024-11-07T22:53:51.149ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85532024-11-07T22:53:51.149ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "889a86e9-af80-4faa-b84b-b8ccc77f58dc", "content-length": "372", "date": "Thu, 07 Nov 2024 22:53:51 GMT"} })
85542024-11-07T22:53:51.150ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85552024-11-07T22:53:51.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85562024-11-07T22:53:51.155ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85572024-11-07T22:53:51.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123455 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5051d5bc-d9fe-4838-8445-5c57f0ef304c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
85582024-11-07T22:53:51.159ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85592024-11-07T22:53:51.159ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85602024-11-07T22:53:51.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85612024-11-07T22:53:51.161ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
85622024-11-07T22:53:51.161ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
85632024-11-07T22:53:51.162ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-07 22:43:11.086261 UTC dns_group = internal generation = 1
85642024-11-07T22:53:51.162ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 343.202101ms iteration = 13 status = {"generation":1}
85652024-11-07T22:53:51.172ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 353.999263ms iteration = 27 status = {"physical_disks_added":0}
85662024-11-07T22:53:51.195ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 376.832038ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
85672024-11-07T22:53:51.198ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85682024-11-07T22:53:51.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
85692024-11-07T22:53:51.201ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85702024-11-07T22:53:51.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85712024-11-07T22:53:51.207ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-07T22:42:48.907310Z, time_modified: 2024-11-07T22:42:48.907310Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }) }
85722024-11-07T22:53:51.207ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 388.632757ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]}},"default_endpoint":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
85732024-11-07T22:53:51.211ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
85742024-11-07T22:53:51.213ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
85752024-11-07T22:53:51.213ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
85762024-11-07T22:53:51.213ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "634f7d40-c62b-4c60-b085-5a832a9e7bc9", "date": "Thu, 07 Nov 2024 22:53:51 GMT"} })
85772024-11-07T22:53:51.213ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85782024-11-07T22:53:51.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85792024-11-07T22:53:51.214ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
85802024-11-07T22:53:51.214ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b6e81cc4-f69c-4b49-8367-00c0c3e5d70a", "date": "Thu, 07 Nov 2024 22:53:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85812024-11-07T22:53:51.214ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85822024-11-07T22:53:51.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85832024-11-07T22:53:51.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85842024-11-07T22:53:51.217ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1f2743a9-efb9-48ca-ac2b-119a29e19fce", "date": "Thu, 07 Nov 2024 22:53:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85852024-11-07T22:53:51.217ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85862024-11-07T22:53:51.219ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85872024-11-07T22:53:51.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85882024-11-07T22:53:51.220ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85892024-11-07T22:53:51.220ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 401.410342ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
85902024-11-07T22:53:51.222ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
85912024-11-07T22:53:51.222ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85922024-11-07T22:53:51.222ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "902dbd1a-cf44-4a0e-bd32-9350d2bad3e2", "date": "Thu, 07 Nov 2024 22:53:51 GMT"} })
85932024-11-07T22:53:51.224ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 405.630946ms iteration = 24 status = {}
85942024-11-07T22:53:51.233ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
85952024-11-07T22:53:51.233ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 0 version = 2
85962024-11-07T22:53:51.233ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85972024-11-07T22:53:51.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85982024-11-07T22:53:51.234ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85992024-11-07T22:53:51.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86002024-11-07T22:53:51.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86012024-11-07T22:53:51.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86022024-11-07T22:53:51.241ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 1 version = 2
86032024-11-07T22:53:51.241ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
86042024-11-07T22:53:51.241ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-07 22:43:11.643428 UTC dns_group = external generation = 2
86052024-11-07T22:53:51.241ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 422.48111ms iteration = 13 status = {"generation":2}
86062024-11-07T22:53:51.276ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
86072024-11-07T22:53:51.276ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 457.3206ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
86082024-11-07T22:53:51.321ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
86092024-11-07T22:53:51.321ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ad0c972-ab01-435c-875d-011b35d117ce", "content-length": "1", "date": "Thu, 07 Nov 2024 22:53:50 GMT"} })
86102024-11-07T22:53:51.323ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86112024-11-07T22:53:51.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86122024-11-07T22:53:51.325ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 507.222317ms iteration = 23 status = null
86132024-11-07T22:53:51.329ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 510.767213ms iteration = 23 status = {}
86142024-11-07T22:53:51.333ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
86152024-11-07T22:53:51.333ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "663a32a1-fbee-4f42-86ba-abcac9e6951a", "date": "Thu, 07 Nov 2024 22:53:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
86162024-11-07T22:53:51.333ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
86172024-11-07T22:53:51.334ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "1b325925-28f3-4b6f-bc98-fd3f566bc48b", "date": "Thu, 07 Nov 2024 22:53:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
86182024-11-07T22:53:51.334ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
86192024-11-07T22:53:51.336ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "bb53e305-11a6-4186-a14b-002ac664c6cc", "date": "Thu, 07 Nov 2024 22:53:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
86202024-11-07T22:53:51.336ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
86212024-11-07T22:53:51.338ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
86222024-11-07T22:53:51.338ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 520.134316ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
86232024-11-07T22:53:51.368ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86242024-11-07T22:53:51.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86252024-11-07T22:53:51.370ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
86262024-11-07T22:53:51.370ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86272024-11-07T22:53:51.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86282024-11-07T22:53:51.380ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
86292024-11-07T22:53:51.380ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f8cbc1c-3c1c-4ad5-a4c1-f09a43784c03", "content-length": "134", "date": "Thu, 07 Nov 2024 22:53:51 GMT"} })
86302024-11-07T22:53:51.380ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
86312024-11-07T22:53:51.380ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
86322024-11-07T22:53:51.380ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
86332024-11-07T22:53:51.380ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
86342024-11-07T22:53:51.380ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86352024-11-07T22:53:51.380ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86362024-11-07T22:53:51.380ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86372024-11-07T22:53:51.380ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
86382024-11-07T22:53:51.380ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86392024-11-07T22:53:51.380ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
86402024-11-07T22:53:51.381ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
86412024-11-07T22:53:51.381ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86422024-11-07T22:53:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86432024-11-07T22:53:51.383ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
86442024-11-07T22:53:51.383ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d1dd350-5ab2-4d37-84eb-fa97b3c07ea7", "content-length": "2", "date": "Thu, 07 Nov 2024 22:53:51 GMT"} })
86452024-11-07T22:53:51.383ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
86462024-11-07T22:53:51.383ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2d6d1f8-e08c-4a6b-a5b8-c1ee447a7e3f", "content-length": "52", "date": "Thu, 07 Nov 2024 22:53:51 GMT"} })
86472024-11-07T22:53:51.383ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
86482024-11-07T22:53:51.383ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
86492024-11-07T22:53:51.548ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "52b61b2d-89d7-4cb3-be10-b20785e44e86", "date": "Thu, 07 Nov 2024 22:53:51 GMT"} })
86502024-11-07T22:53:51.549ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
86512024-11-07T22:53:51.549ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
86522024-11-07T22:53:51.553ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cffb7b1c-0c56-41c5-b8ff-d767ceac9bcc", "content-length": "682", "date": "Thu, 07 Nov 2024 22:53:51 GMT"} })
86532024-11-07T22:53:51.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86542024-11-07T22:53:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86552024-11-07T22:53:51.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86562024-11-07T22:53:51.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86572024-11-07T22:53:51.560ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86582024-11-07T22:53:51.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86592024-11-07T22:53:51.562ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86602024-11-07T22:53:51.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86612024-11-07T22:53:51.569ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 751.006796ms iteration = 23 status = {}
86622024-11-07T22:53:52.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 6b5fbea0-14e3-445d-a350-130623947d37 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
86632024-11-07T22:53:52.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 6b5fbea0-14e3-445d-a350-130623947d37 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
86642024-11-07T22:53:52.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 6b5fbea0-14e3-445d-a350-130623947d37 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
86652024-11-07T22:53:52.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f70ce163-fd26-42fc-b66c-0c7e55c03cbb roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86662024-11-07T22:53:52.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f70ce163-fd26-42fc-b66c-0c7e55c03cbb resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86672024-11-07T22:53:52.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f70ce163-fd26-42fc-b66c-0c7e55c03cbb response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86682024-11-07T22:53:53.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ee40b427-04ea-4240-bffe-79f6fc120b46 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86692024-11-07T22:53:53.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ee40b427-04ea-4240-bffe-79f6fc120b46 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86702024-11-07T22:53:53.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ee40b427-04ea-4240-bffe-79f6fc120b46 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86712024-11-07T22:53:54.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7d61c779-ae17-4185-b607-57b4568557d6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86722024-11-07T22:53:54.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7d61c779-ae17-4185-b607-57b4568557d6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86732024-11-07T22:53:54.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7d61c779-ae17-4185-b607-57b4568557d6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86742024-11-07T22:53:55.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1b3f7fe3-44f5-416e-9990-eab5e69e9862 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86752024-11-07T22:53:55.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1b3f7fe3-44f5-416e-9990-eab5e69e9862 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86762024-11-07T22:53:55.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1b3f7fe3-44f5-416e-9990-eab5e69e9862 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86772024-11-07T22:53:56.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 060e1464-01ca-4b85-91c4-da7a227ca5a7 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86782024-11-07T22:53:56.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 060e1464-01ca-4b85-91c4-da7a227ca5a7 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86792024-11-07T22:53:56.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 060e1464-01ca-4b85-91c4-da7a227ca5a7 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86802024-11-07T22:53:57.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 20b1cd60-0586-4e45-9543-51aae285c554 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86812024-11-07T22:53:57.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 20b1cd60-0586-4e45-9543-51aae285c554 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86822024-11-07T22:53:57.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1628 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 20b1cd60-0586-4e45-9543-51aae285c554 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86832024-11-07T22:53:58.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 317a0eae-08c1-4a4d-87b7-d81501c66358 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86842024-11-07T22:53:58.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 317a0eae-08c1-4a4d-87b7-d81501c66358 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86852024-11-07T22:53:58.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 317a0eae-08c1-4a4d-87b7-d81501c66358 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86862024-11-07T22:53:59.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d8cffe42-0eb6-4865-9a07-77d8d262ee53 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86872024-11-07T22:53:59.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d8cffe42-0eb6-4865-9a07-77d8d262ee53 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86882024-11-07T22:53:59.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2496 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d8cffe42-0eb6-4865-9a07-77d8d262ee53 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86892024-11-07T22:54:00.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cdd7eb06-669c-4a4d-b3c5-b1d3dd5382e8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86902024-11-07T22:54:00.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cdd7eb06-669c-4a4d-b3c5-b1d3dd5382e8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86912024-11-07T22:54:00.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = cdd7eb06-669c-4a4d-b3c5-b1d3dd5382e8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
86922024-11-07T22:54:00.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
86932024-11-07T22:54:00.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
86942024-11-07T22:54:00.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86952024-11-07T22:54:00.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86962024-11-07T22:54:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86972024-11-07T22:54:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86982024-11-07T22:54:00.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86992024-11-07T22:54:00.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87002024-11-07T22:54:00.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87012024-11-07T22:54:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87022024-11-07T22:54:00.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87032024-11-07T22:54:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87042024-11-07T22:54:00.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87052024-11-07T22:54:00.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87062024-11-07T22:54:00.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87072024-11-07T22:54:00.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
87082024-11-07T22:54:00.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87092024-11-07T22:54:00.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87102024-11-07T22:54:00.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
87112024-11-07T22:54:00.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.878254ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
87122024-11-07T22:54:00.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.316802ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87132024-11-07T22:54:01.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e3863294-a51f-43a8-9e18-db66d0498953 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87142024-11-07T22:54:01.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e3863294-a51f-43a8-9e18-db66d0498953 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87152024-11-07T22:54:01.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e3863294-a51f-43a8-9e18-db66d0498953 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87162024-11-07T22:54:01.654ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1409 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 612081b5-7f33-43f5-b4c2-92f9bd8b5246 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
87172024-11-07T22:54:02.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 44993780-52eb-4dc7-b50e-31456335645d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87182024-11-07T22:54:02.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 44993780-52eb-4dc7-b50e-31456335645d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87192024-11-07T22:54:02.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 44993780-52eb-4dc7-b50e-31456335645d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87202024-11-07T22:54:03.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ca86d6ef-066c-4044-af70-2d06ef06eeb2 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87212024-11-07T22:54:03.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ca86d6ef-066c-4044-af70-2d06ef06eeb2 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87222024-11-07T22:54:03.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ca86d6ef-066c-4044-af70-2d06ef06eeb2 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87232024-11-07T22:54:04.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 21f2a859-f269-439b-8f5b-ef2e05da9bac roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87242024-11-07T22:54:04.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 21f2a859-f269-439b-8f5b-ef2e05da9bac resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87252024-11-07T22:54:04.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 21f2a859-f269-439b-8f5b-ef2e05da9bac response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87262024-11-07T22:54:05.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 28fca613-1431-499d-92f5-22b4272d5aa5 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87272024-11-07T22:54:05.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 28fca613-1431-499d-92f5-22b4272d5aa5 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87282024-11-07T22:54:05.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1932 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 28fca613-1431-499d-92f5-22b4272d5aa5 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87292024-11-07T22:54:06.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0e037eeb-8a6a-47f9-8032-0476f558b8d9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87302024-11-07T22:54:06.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0e037eeb-8a6a-47f9-8032-0476f558b8d9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87312024-11-07T22:54:06.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0e037eeb-8a6a-47f9-8032-0476f558b8d9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87322024-11-07T22:54:07.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0e16187b-741f-42b4-9e8d-db212930ad0c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87332024-11-07T22:54:07.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0e16187b-741f-42b4-9e8d-db212930ad0c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87342024-11-07T22:54:07.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2558 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0e16187b-741f-42b4-9e8d-db212930ad0c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87352024-11-07T22:54:08.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9eb382e5-8838-492e-bad6-b180dab7b368 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87362024-11-07T22:54:08.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9eb382e5-8838-492e-bad6-b180dab7b368 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87372024-11-07T22:54:08.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2704 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9eb382e5-8838-492e-bad6-b180dab7b368 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87382024-11-07T22:54:09.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 036a33e9-077c-4c57-ac7f-59357991091a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87392024-11-07T22:54:09.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 036a33e9-077c-4c57-ac7f-59357991091a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87402024-11-07T22:54:09.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1871 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 036a33e9-077c-4c57-ac7f-59357991091a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87412024-11-07T22:54:10.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 35f35b34-79b1-4009-8211-44f335a69dc9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87422024-11-07T22:54:10.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 35f35b34-79b1-4009-8211-44f335a69dc9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87432024-11-07T22:54:10.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 35f35b34-79b1-4009-8211-44f335a69dc9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87442024-11-07T22:54:10.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
87452024-11-07T22:54:10.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
87462024-11-07T22:54:10.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87472024-11-07T22:54:10.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87482024-11-07T22:54:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87492024-11-07T22:54:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87502024-11-07T22:54:10.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87512024-11-07T22:54:10.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87522024-11-07T22:54:10.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87532024-11-07T22:54:10.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87542024-11-07T22:54:10.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87552024-11-07T22:54:10.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87562024-11-07T22:54:10.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87572024-11-07T22:54:10.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87582024-11-07T22:54:10.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87592024-11-07T22:54:10.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
87602024-11-07T22:54:10.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87612024-11-07T22:54:10.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87622024-11-07T22:54:10.841ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
87632024-11-07T22:54:10.841ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.952309ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
87642024-11-07T22:54:10.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.231763ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87652024-11-07T22:54:11.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 696ccae4-9d22-44b1-869e-bfcb54266779 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87662024-11-07T22:54:11.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 696ccae4-9d22-44b1-869e-bfcb54266779 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87672024-11-07T22:54:11.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2508 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 696ccae4-9d22-44b1-869e-bfcb54266779 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87682024-11-07T22:54:12.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 54a041bf-2488-480b-b4aa-f642e5ee31da roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87692024-11-07T22:54:12.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 54a041bf-2488-480b-b4aa-f642e5ee31da resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87702024-11-07T22:54:12.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 54a041bf-2488-480b-b4aa-f642e5ee31da response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87712024-11-07T22:54:13.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 21fa21bb-dee7-427a-b5f0-961dc2f3a50c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87722024-11-07T22:54:13.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 21fa21bb-dee7-427a-b5f0-961dc2f3a50c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87732024-11-07T22:54:13.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 21fa21bb-dee7-427a-b5f0-961dc2f3a50c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87742024-11-07T22:54:14.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = adc859dd-9c31-4031-9ef2-17d480c25429 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87752024-11-07T22:54:14.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = adc859dd-9c31-4031-9ef2-17d480c25429 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87762024-11-07T22:54:14.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = adc859dd-9c31-4031-9ef2-17d480c25429 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87772024-11-07T22:54:15.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f679a914-92a7-46ab-a4fc-1aa8cf8c4c13 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87782024-11-07T22:54:15.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f679a914-92a7-46ab-a4fc-1aa8cf8c4c13 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87792024-11-07T22:54:15.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f679a914-92a7-46ab-a4fc-1aa8cf8c4c13 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87802024-11-07T22:54:16.655ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1410 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 19f2a6f1-0762-4907-921e-80510edddc13 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
87812024-11-07T22:54:16.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9caeb2b6-8dce-46c4-a725-6d5d5c02fbeb roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87822024-11-07T22:54:16.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9caeb2b6-8dce-46c4-a725-6d5d5c02fbeb resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87832024-11-07T22:54:16.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2504 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9caeb2b6-8dce-46c4-a725-6d5d5c02fbeb response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87842024-11-07T22:54:17.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 082d4593-d048-4bee-b9e6-9a66d5276bc7 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87852024-11-07T22:54:17.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 082d4593-d048-4bee-b9e6-9a66d5276bc7 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87862024-11-07T22:54:17.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2562 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 082d4593-d048-4bee-b9e6-9a66d5276bc7 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87872024-11-07T22:54:18.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6b80fa7f-18be-4733-8fd6-47dbe137b14f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87882024-11-07T22:54:18.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6b80fa7f-18be-4733-8fd6-47dbe137b14f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87892024-11-07T22:54:18.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6b80fa7f-18be-4733-8fd6-47dbe137b14f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87902024-11-07T22:54:19.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 19a01e9c-8906-47b1-b151-317b82cc08c4 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87912024-11-07T22:54:19.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 19a01e9c-8906-47b1-b151-317b82cc08c4 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87922024-11-07T22:54:19.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2551 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 19a01e9c-8906-47b1-b151-317b82cc08c4 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
87932024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
87942024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
87952024-11-07T22:54:20.818ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
87962024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87972024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87982024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
87992024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
88002024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88012024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
88022024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
88032024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
88042024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
88052024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88062024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88072024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
88082024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88092024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
88102024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88112024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
88122024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88132024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
88142024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
88152024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88162024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88172024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
88182024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88192024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
88202024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
88212024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
88222024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88232024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
88242024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
88252024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
88262024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
88272024-11-07T22:54:20.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88282024-11-07T22:54:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
88292024-11-07T22:54:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88302024-11-07T22:54:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88312024-11-07T22:54:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88322024-11-07T22:54:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88332024-11-07T22:54:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88342024-11-07T22:54:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88352024-11-07T22:54:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88362024-11-07T22:54:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
88372024-11-07T22:54:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88382024-11-07T22:54:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88392024-11-07T22:54:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88402024-11-07T22:54:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88412024-11-07T22:54:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
88422024-11-07T22:54:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88432024-11-07T22:54:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88442024-11-07T22:54:20.821ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88452024-11-07T22:54:20.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88462024-11-07T22:54:20.822ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.898195ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
88472024-11-07T22:54:20.823ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88482024-11-07T22:54:20.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88492024-11-07T22:54:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88502024-11-07T22:54:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88512024-11-07T22:54:20.824ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88522024-11-07T22:54:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88532024-11-07T22:54:20.826ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88542024-11-07T22:54:20.827ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1354, tv_nsec: 916393393 } })
88552024-11-07T22:54:20.827ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
88562024-11-07T22:54:20.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
88572024-11-07T22:54:20.828ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88582024-11-07T22:54:20.828ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.847906ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
88592024-11-07T22:54:20.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88602024-11-07T22:54:20.831ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1354, tv_nsec: 920136514 } })
88612024-11-07T22:54:20.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88622024-11-07T22:54:20.831ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
88632024-11-07T22:54:20.832ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88642024-11-07T22:54:20.832ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1354, tv_nsec: 921656625 } })
88652024-11-07T22:54:20.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88662024-11-07T22:54:20.832ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
88672024-11-07T22:54:20.833ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88682024-11-07T22:54:20.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88692024-11-07T22:54:20.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88702024-11-07T22:54:20.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 38.099368ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
88712024-11-07T22:54:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88722024-11-07T22:54:20.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88732024-11-07T22:54:20.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b83c11a7-3ec9-4957-9896-53532b690732 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
88742024-11-07T22:54:20.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b83c11a7-3ec9-4957-9896-53532b690732 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
88752024-11-07T22:54:20.866ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88762024-11-07T22:54:20.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88772024-11-07T22:54:20.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4691 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b83c11a7-3ec9-4957-9896-53532b690732 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
88782024-11-07T22:54:20.869ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88792024-11-07T22:54:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88802024-11-07T22:54:20.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88812024-11-07T22:54:20.871ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 52.771544ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
88822024-11-07T22:54:20.871ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88832024-11-07T22:54:20.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88842024-11-07T22:54:20.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88852024-11-07T22:54:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
88862024-11-07T22:54:20.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88872024-11-07T22:54:20.873ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.060626ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88882024-11-07T22:54:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88892024-11-07T22:54:20.875ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88902024-11-07T22:54:20.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88912024-11-07T22:54:20.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88922024-11-07T22:54:20.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88932024-11-07T22:54:20.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88942024-11-07T22:54:20.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88952024-11-07T22:54:20.877ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88962024-11-07T22:54:20.877ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
88972024-11-07T22:54:20.877ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88982024-11-07T22:54:20.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88992024-11-07T22:54:20.879ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89002024-11-07T22:54:20.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89012024-11-07T22:54:20.879ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89022024-11-07T22:54:20.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89032024-11-07T22:54:20.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89042024-11-07T22:54:20.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89052024-11-07T22:54:20.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89062024-11-07T22:54:20.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
89072024-11-07T22:54:20.882ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89082024-11-07T22:54:20.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89092024-11-07T22:54:20.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
89102024-11-07T22:54:20.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89112024-11-07T22:54:20.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89122024-11-07T22:54:20.902ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
89132024-11-07T22:54:20.902ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.10152ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
89142024-11-07T22:54:20.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89152024-11-07T22:54:20.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89162024-11-07T22:54:20.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89172024-11-07T22:54:20.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89182024-11-07T22:54:20.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89192024-11-07T22:54:20.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89202024-11-07T22:54:20.913ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
89212024-11-07T22:54:20.913ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89222024-11-07T22:54:20.913ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89232024-11-07T22:54:20.913ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
89242024-11-07T22:54:20.913ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89252024-11-07T22:54:20.913ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "62504355-885e-412b-b483-fbbc5a06ed33", "content-length": "26", "date": "Thu, 07 Nov 2024 22:54:20 GMT"} })
89262024-11-07T22:54:20.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89272024-11-07T22:54:20.913ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89282024-11-07T22:54:20.915ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89292024-11-07T22:54:20.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.268529ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
89302024-11-07T22:54:20.925ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
89312024-11-07T22:54:20.925ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 106.892014ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
89322024-11-07T22:54:20.950ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 132.408943ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
89332024-11-07T22:54:20.950ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89342024-11-07T22:54:20.951ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
89352024-11-07T22:54:20.951ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89362024-11-07T22:54:20.951ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "22233d21-96eb-49ca-90ad-8f4656baba3a", "content-length": "26", "date": "Thu, 07 Nov 2024 22:54:20 GMT"} })
89372024-11-07T22:54:20.951ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89382024-11-07T22:54:20.953ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
89392024-11-07T22:54:20.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
89402024-11-07T22:54:20.953ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89412024-11-07T22:54:20.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89422024-11-07T22:54:20.956ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 138.153148ms iteration = 24 status = 0
89432024-11-07T22:54:20.959ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89442024-11-07T22:54:20.959ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
89452024-11-07T22:54:20.959ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.688276ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
89462024-11-07T22:54:20.966ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89472024-11-07T22:54:20.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89482024-11-07T22:54:21.011ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
89492024-11-07T22:54:21.011ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89502024-11-07T22:54:21.012ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aff3050f-21b5-403e-a07e-b523bd373f24", "content-length": "26", "date": "Thu, 07 Nov 2024 22:54:20 GMT"} })
89512024-11-07T22:54:21.012ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89522024-11-07T22:54:21.013ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89532024-11-07T22:54:21.017ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89542024-11-07T22:54:21.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89552024-11-07T22:54:21.019ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 201.042385ms iteration = 28 status = {"physical_disks_added":0}
89562024-11-07T22:54:21.023ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89572024-11-07T22:54:21.026ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89582024-11-07T22:54:21.026ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89592024-11-07T22:54:21.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89602024-11-07T22:54:21.031ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89612024-11-07T22:54:21.033ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89622024-11-07T22:54:21.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89632024-11-07T22:54:21.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89642024-11-07T22:54:21.076ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 258.042353ms iteration = 24 status = {}
89652024-11-07T22:54:21.081ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
89662024-11-07T22:54:21.081ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89672024-11-07T22:54:21.084ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b833cf9-5c7d-4c04-a555-9a93e8749512", "content-length": "372", "date": "Thu, 07 Nov 2024 22:54:21 GMT"} })
89682024-11-07T22:54:21.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89692024-11-07T22:54:21.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89702024-11-07T22:54:21.101ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
89712024-11-07T22:54:21.101ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
89722024-11-07T22:54:21.101ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7b19d241-bb58-475a-b064-e55525acea1f", "date": "Thu, 07 Nov 2024 22:54:21 GMT"} })
89732024-11-07T22:54:21.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89742024-11-07T22:54:21.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89752024-11-07T22:54:21.102ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
89762024-11-07T22:54:21.103ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba316500-e320-4a88-a22d-50911ee94a2a", "content-length": "1", "date": "Thu, 07 Nov 2024 22:54:20 GMT"} })
89772024-11-07T22:54:21.104ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89782024-11-07T22:54:21.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89792024-11-07T22:54:21.104ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89802024-11-07T22:54:21.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89812024-11-07T22:54:21.107ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 288.814824ms iteration = 24 status = null
89822024-11-07T22:54:21.107ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89832024-11-07T22:54:21.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89842024-11-07T22:54:21.111ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
89852024-11-07T22:54:21.111ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89862024-11-07T22:54:21.111ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d4dfbaed-4bcb-4401-8a1e-175ef0bf3c01", "date": "Thu, 07 Nov 2024 22:54:21 GMT"} })
89872024-11-07T22:54:21.114ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 296.517921ms iteration = 25 status = {}
89882024-11-07T22:54:21.178ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89892024-11-07T22:54:21.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89902024-11-07T22:54:21.180ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
89912024-11-07T22:54:21.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89922024-11-07T22:54:21.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89932024-11-07T22:54:21.187ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
89942024-11-07T22:54:21.187ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f191c61-dac8-4624-b811-4966424664c1", "content-length": "134", "date": "Thu, 07 Nov 2024 22:54:21 GMT"} })
89952024-11-07T22:54:21.187ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
89962024-11-07T22:54:21.187ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
89972024-11-07T22:54:21.188ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
89982024-11-07T22:54:21.188ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
89992024-11-07T22:54:21.188ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90002024-11-07T22:54:21.188ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90012024-11-07T22:54:21.188ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90022024-11-07T22:54:21.188ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90032024-11-07T22:54:21.188ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90042024-11-07T22:54:21.188ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90052024-11-07T22:54:21.188ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
90062024-11-07T22:54:21.188ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90072024-11-07T22:54:21.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90082024-11-07T22:54:21.190ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
90092024-11-07T22:54:21.190ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b6a3ffd-fed0-49c1-bc63-dd629bf22540", "content-length": "2", "date": "Thu, 07 Nov 2024 22:54:21 GMT"} })
90102024-11-07T22:54:21.190ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
90112024-11-07T22:54:21.190ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "829bf148-523d-4b7b-b323-c3f143d39f0f", "content-length": "52", "date": "Thu, 07 Nov 2024 22:54:21 GMT"} })
90122024-11-07T22:54:21.190ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
90132024-11-07T22:54:21.190ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
90142024-11-07T22:54:21.201ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
90152024-11-07T22:54:21.303ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4239241f-8737-4bee-bf65-675c0f879258", "date": "Thu, 07 Nov 2024 22:54:21 GMT"} })
90162024-11-07T22:54:21.303ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
90172024-11-07T22:54:21.303ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
90182024-11-07T22:54:21.304ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "96b40641-5939-434c-9f33-f125e196e67d", "content-length": "691", "date": "Thu, 07 Nov 2024 22:54:21 GMT"} })
90192024-11-07T22:54:21.304ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
90202024-11-07T22:54:21.304ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
90212024-11-07T22:54:21.304ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
90222024-11-07T22:54:21.304ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "929ff24a-c349-47b8-aaa1-4def598c098d", "content-length": "682", "date": "Thu, 07 Nov 2024 22:54:21 GMT"} })
90232024-11-07T22:54:21.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90242024-11-07T22:54:21.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90252024-11-07T22:54:21.305ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 487.367321ms iteration = 24 status = {}
90262024-11-07T22:54:21.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90272024-11-07T22:54:21.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90282024-11-07T22:54:21.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90292024-11-07T22:54:21.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90302024-11-07T22:54:21.312ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90312024-11-07T22:54:21.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90322024-11-07T22:54:21.320ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 502.002847ms iteration = 24 status = {}
90332024-11-07T22:54:21.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = bfe71de4-7d81-40e6-a864-194115961cfc roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
90342024-11-07T22:54:21.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = bfe71de4-7d81-40e6-a864-194115961cfc resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
90352024-11-07T22:54:21.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2680 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = bfe71de4-7d81-40e6-a864-194115961cfc response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
90362024-11-07T22:54:21.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 6616e349-7be8-469f-ae4e-10f2f7a665b4 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
90372024-11-07T22:54:21.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 6616e349-7be8-469f-ae4e-10f2f7a665b4 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
90382024-11-07T22:54:21.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 6616e349-7be8-469f-ae4e-10f2f7a665b4 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
90392024-11-07T22:54:21.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a05ca303-bb9e-4d65-8898-533397a9ef70 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90402024-11-07T22:54:21.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a05ca303-bb9e-4d65-8898-533397a9ef70 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90412024-11-07T22:54:21.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a05ca303-bb9e-4d65-8898-533397a9ef70 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90422024-11-07T22:54:22.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = ce28483a-8ff7-46e2-8ba5-c9488d8b6da0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
90432024-11-07T22:54:22.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = ce28483a-8ff7-46e2-8ba5-c9488d8b6da0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
90442024-11-07T22:54:22.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3481 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = ce28483a-8ff7-46e2-8ba5-c9488d8b6da0 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
90452024-11-07T22:54:22.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c54b93eb-8c07-43db-8d37-60ee25fce602 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90462024-11-07T22:54:22.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c54b93eb-8c07-43db-8d37-60ee25fce602 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90472024-11-07T22:54:22.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c54b93eb-8c07-43db-8d37-60ee25fce602 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90482024-11-07T22:54:23.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f3fd99d4-ddd8-4e7a-8d22-309cc44a79ae roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90492024-11-07T22:54:23.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f3fd99d4-ddd8-4e7a-8d22-309cc44a79ae resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90502024-11-07T22:54:23.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1804 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f3fd99d4-ddd8-4e7a-8d22-309cc44a79ae response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90512024-11-07T22:54:24.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = edd89624-84ca-4343-91bb-c0e10528c426 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90522024-11-07T22:54:24.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = edd89624-84ca-4343-91bb-c0e10528c426 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90532024-11-07T22:54:24.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1658 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = edd89624-84ca-4343-91bb-c0e10528c426 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90542024-11-07T22:54:25.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 132309ff-6190-4921-9796-62313863f89f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90552024-11-07T22:54:25.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 132309ff-6190-4921-9796-62313863f89f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90562024-11-07T22:54:26.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 132309ff-6190-4921-9796-62313863f89f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90572024-11-07T22:54:27.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f8c4607c-1431-4538-942e-6e7262f9244f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90582024-11-07T22:54:27.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f8c4607c-1431-4538-942e-6e7262f9244f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90592024-11-07T22:54:27.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f8c4607c-1431-4538-942e-6e7262f9244f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90602024-11-07T22:54:28.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 15cbe26b-2678-4b35-8d66-86774c6d9324 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90612024-11-07T22:54:28.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 15cbe26b-2678-4b35-8d66-86774c6d9324 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90622024-11-07T22:54:28.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 15cbe26b-2678-4b35-8d66-86774c6d9324 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90632024-11-07T22:54:29.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e9c3015f-948b-4b42-9baa-fb62fca87521 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90642024-11-07T22:54:29.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e9c3015f-948b-4b42-9baa-fb62fca87521 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90652024-11-07T22:54:29.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e9c3015f-948b-4b42-9baa-fb62fca87521 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90662024-11-07T22:54:30.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ef818722-f773-400c-8421-09da6d3e8585 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90672024-11-07T22:54:30.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ef818722-f773-400c-8421-09da6d3e8585 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90682024-11-07T22:54:30.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ef818722-f773-400c-8421-09da6d3e8585 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90692024-11-07T22:54:30.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
90702024-11-07T22:54:30.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
90712024-11-07T22:54:30.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90722024-11-07T22:54:30.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90732024-11-07T22:54:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90742024-11-07T22:54:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90752024-11-07T22:54:30.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90762024-11-07T22:54:30.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90772024-11-07T22:54:30.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90782024-11-07T22:54:30.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90792024-11-07T22:54:30.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90802024-11-07T22:54:30.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90812024-11-07T22:54:30.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90822024-11-07T22:54:30.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90832024-11-07T22:54:30.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90842024-11-07T22:54:30.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
90852024-11-07T22:54:30.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90862024-11-07T22:54:30.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90872024-11-07T22:54:30.837ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
90882024-11-07T22:54:30.837ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.929701ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
90892024-11-07T22:54:30.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.644144ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90902024-11-07T22:54:31.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 554b613a-3ba5-43c0-bbf0-7b2ecaf2b2b9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90912024-11-07T22:54:31.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 554b613a-3ba5-43c0-bbf0-7b2ecaf2b2b9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90922024-11-07T22:54:31.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 554b613a-3ba5-43c0-bbf0-7b2ecaf2b2b9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90932024-11-07T22:54:31.653ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1315 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = c154733c-ce78-4338-a2b9-0e40e8e171ba response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
90942024-11-07T22:54:32.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 076f6044-48d6-4471-909f-ea548a3470ba roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90952024-11-07T22:54:32.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 076f6044-48d6-4471-909f-ea548a3470ba resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90962024-11-07T22:54:32.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1845 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 076f6044-48d6-4471-909f-ea548a3470ba response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90972024-11-07T22:54:33.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ded7813b-dff9-42fe-ab07-fde72dd6ccb6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90982024-11-07T22:54:33.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ded7813b-dff9-42fe-ab07-fde72dd6ccb6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
90992024-11-07T22:54:33.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ded7813b-dff9-42fe-ab07-fde72dd6ccb6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91002024-11-07T22:54:34.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b66e272f-e0fd-4198-9c14-bdcf65fa968e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91012024-11-07T22:54:34.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b66e272f-e0fd-4198-9c14-bdcf65fa968e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91022024-11-07T22:54:34.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b66e272f-e0fd-4198-9c14-bdcf65fa968e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91032024-11-07T22:54:35.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c5b0d168-5120-4b12-a799-10f5e8d0ae51 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91042024-11-07T22:54:35.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c5b0d168-5120-4b12-a799-10f5e8d0ae51 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91052024-11-07T22:54:35.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1911 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c5b0d168-5120-4b12-a799-10f5e8d0ae51 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91062024-11-07T22:54:36.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 49dcb724-e6a5-4b57-88f6-f4145e4fccd2 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91072024-11-07T22:54:36.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 49dcb724-e6a5-4b57-88f6-f4145e4fccd2 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91082024-11-07T22:54:36.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 49dcb724-e6a5-4b57-88f6-f4145e4fccd2 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91092024-11-07T22:54:37.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 927e4d3e-3bfb-477a-9512-2514bccf7caa roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91102024-11-07T22:54:37.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 927e4d3e-3bfb-477a-9512-2514bccf7caa resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91112024-11-07T22:54:37.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 927e4d3e-3bfb-477a-9512-2514bccf7caa response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91122024-11-07T22:54:38.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ddf8c595-8d18-402b-bcfe-edf0515f272a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91132024-11-07T22:54:38.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ddf8c595-8d18-402b-bcfe-edf0515f272a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91142024-11-07T22:54:38.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ddf8c595-8d18-402b-bcfe-edf0515f272a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91152024-11-07T22:54:39.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f2233b8e-62e0-4e97-9bca-00750f8697fd roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91162024-11-07T22:54:39.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f2233b8e-62e0-4e97-9bca-00750f8697fd resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91172024-11-07T22:54:39.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1700 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f2233b8e-62e0-4e97-9bca-00750f8697fd response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91182024-11-07T22:54:40.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2fbad7ae-2167-4ecc-b454-9b879bc170cf roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91192024-11-07T22:54:40.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2fbad7ae-2167-4ecc-b454-9b879bc170cf resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91202024-11-07T22:54:40.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2fbad7ae-2167-4ecc-b454-9b879bc170cf response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91212024-11-07T22:54:40.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
91222024-11-07T22:54:40.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
91232024-11-07T22:54:40.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91242024-11-07T22:54:40.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91252024-11-07T22:54:40.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91262024-11-07T22:54:40.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91272024-11-07T22:54:40.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91282024-11-07T22:54:40.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91292024-11-07T22:54:40.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91302024-11-07T22:54:40.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.207833ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91312024-11-07T22:54:40.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91322024-11-07T22:54:40.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91332024-11-07T22:54:40.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91342024-11-07T22:54:40.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91352024-11-07T22:54:40.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91362024-11-07T22:54:40.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91372024-11-07T22:54:40.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
91382024-11-07T22:54:40.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91392024-11-07T22:54:40.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91402024-11-07T22:54:40.840ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
91412024-11-07T22:54:40.840ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.537561ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
91422024-11-07T22:54:41.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2e31cd47-0ee5-458e-a206-3c7ebadef133 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91432024-11-07T22:54:41.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2e31cd47-0ee5-458e-a206-3c7ebadef133 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91442024-11-07T22:54:41.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2e31cd47-0ee5-458e-a206-3c7ebadef133 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91452024-11-07T22:54:42.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 0b4746d7-02be-4851-8ce9-a68b80d50102 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
91462024-11-07T22:54:42.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 0b4746d7-02be-4851-8ce9-a68b80d50102 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
91472024-11-07T22:54:42.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 0b4746d7-02be-4851-8ce9-a68b80d50102 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
91482024-11-07T22:54:42.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = fa8b5ae8-d7a1-400e-987e-8f3a61866f8b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
91492024-11-07T22:54:42.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = fa8b5ae8-d7a1-400e-987e-8f3a61866f8b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
91502024-11-07T22:54:42.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = fa8b5ae8-d7a1-400e-987e-8f3a61866f8b response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
91512024-11-07T22:54:42.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7210a7b2-3cd8-4fda-8761-e76c764abca7 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91522024-11-07T22:54:42.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7210a7b2-3cd8-4fda-8761-e76c764abca7 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91532024-11-07T22:54:42.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7210a7b2-3cd8-4fda-8761-e76c764abca7 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91542024-11-07T22:54:43.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a3e382a1-fbfd-42be-8792-55ebe4ff8ef5 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91552024-11-07T22:54:43.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a3e382a1-fbfd-42be-8792-55ebe4ff8ef5 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91562024-11-07T22:54:43.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a3e382a1-fbfd-42be-8792-55ebe4ff8ef5 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91572024-11-07T22:54:44.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0fbf1c41-2bba-45de-bec7-cf4a24eb9ff3 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91582024-11-07T22:54:44.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0fbf1c41-2bba-45de-bec7-cf4a24eb9ff3 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91592024-11-07T22:54:44.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2462 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0fbf1c41-2bba-45de-bec7-cf4a24eb9ff3 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91602024-11-07T22:54:45.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f0cfd785-c502-4a09-8f3c-eeb505b4daf5 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91612024-11-07T22:54:45.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f0cfd785-c502-4a09-8f3c-eeb505b4daf5 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91622024-11-07T22:54:45.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2609 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f0cfd785-c502-4a09-8f3c-eeb505b4daf5 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91632024-11-07T22:54:46.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 80f2697d-e7cd-4dff-b6e4-173e96f3073f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91642024-11-07T22:54:46.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 80f2697d-e7cd-4dff-b6e4-173e96f3073f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91652024-11-07T22:54:46.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 80f2697d-e7cd-4dff-b6e4-173e96f3073f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91662024-11-07T22:54:46.656ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1391 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 2d5d3c12-fd38-40f8-b3f0-83652bcdb64c response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
91672024-11-07T22:54:47.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = db77d6d8-021e-4fb7-902c-7a02e138a30a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91682024-11-07T22:54:47.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = db77d6d8-021e-4fb7-902c-7a02e138a30a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91692024-11-07T22:54:47.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = db77d6d8-021e-4fb7-902c-7a02e138a30a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91702024-11-07T22:54:48.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8c17007e-a9c6-4707-91e0-33efea839fd9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91712024-11-07T22:54:48.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8c17007e-a9c6-4707-91e0-33efea839fd9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91722024-11-07T22:54:48.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8c17007e-a9c6-4707-91e0-33efea839fd9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91732024-11-07T22:54:48.942ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1ff30d5a-61d9-4c1b-a35d-22390bbfb6e3 uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-07T22:54:48.937144005Z }
91742024-11-07T22:54:48.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1ff30d5a-61d9-4c1b-a35d-22390bbfb6e3 roles = RoleSet { roles: {} } uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
91752024-11-07T22:54:48.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1ff30d5a-61d9-4c1b-a35d-22390bbfb6e3 resource = Database result = Ok(()) uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
91762024-11-07T22:54:48.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 14478 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1ff30d5a-61d9-4c1b-a35d-22390bbfb6e3 response_code = 204 uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
91772024-11-07T22:54:48.963ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 44bd6ba7-b6be-4ee0-b8c6-27646249155d uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-07T22:54:48.963003093Z }
91782024-11-07T22:54:48.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 44bd6ba7-b6be-4ee0-b8c6-27646249155d roles = RoleSet { roles: {} } uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
91792024-11-07T22:54:48.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 44bd6ba7-b6be-4ee0-b8c6-27646249155d resource = Database result = Ok(()) uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
91802024-11-07T22:54:48.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8137 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 44bd6ba7-b6be-4ee0-b8c6-27646249155d response_code = 204 uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
91812024-11-07T22:54:48.973ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:33798
91822024-11-07T22:54:48.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:33798 req_id = 977b8a18-161e-41b0-a9db-8f5768e8eaec roles = RoleSet { roles: {} } uri = /metrics/producers
91832024-11-07T22:54:48.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:33798 req_id = 977b8a18-161e-41b0-a9db-8f5768e8eaec resource = Database result = Ok(()) uri = /metrics/producers
91842024-11-07T22:54:49.010ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a
91852024-11-07T22:54:49.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36328 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:33798 req_id = 977b8a18-161e-41b0-a9db-8f5768e8eaec response_code = 201 uri = /metrics/producers
91862024-11-07T22:54:49.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c80519ea-9714-43cc-bc5b-77b8d91c223c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91872024-11-07T22:54:49.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c80519ea-9714-43cc-bc5b-77b8d91c223c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91882024-11-07T22:54:49.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c80519ea-9714-43cc-bc5b-77b8d91c223c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91892024-11-07T22:54:50.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 05b25cab-062f-481e-b29d-9849e0092643 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91902024-11-07T22:54:50.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 05b25cab-062f-481e-b29d-9849e0092643 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91912024-11-07T22:54:50.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 05b25cab-062f-481e-b29d-9849e0092643 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
91922024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
91932024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
91942024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91952024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
91962024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
91972024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
91982024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
91992024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
92002024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92012024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
92022024-11-07T22:54:50.819ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
92032024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92042024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
92052024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
92062024-11-07T22:54:50.819ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-07 22:44:50.819235001 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
92072024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
92082024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
92092024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
92102024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92112024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92122024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
92132024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
92142024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
92152024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
92162024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92172024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
92182024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
92192024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92202024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
92212024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92222024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
92232024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
92242024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
92252024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92262024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
92272024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
92282024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92292024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
92302024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92312024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
92322024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
92332024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
92342024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92352024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
92362024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92372024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
92382024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92392024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
92402024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
92412024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
92422024-11-07T22:54:50.819ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531
92432024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.27\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531"}
92442024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
92452024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
92462024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
92472024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92482024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
92492024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92502024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
92512024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
92522024-11-07T22:54:50.819ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
92532024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92542024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92552024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92562024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
92572024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
92582024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
92592024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
92602024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92612024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92622024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92632024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
92642024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92652024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92662024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
92672024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92682024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92692024-11-07T22:54:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92702024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92712024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
92722024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
92732024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92742024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92752024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
92762024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92772024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92782024-11-07T22:54:50.820ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a127151b-10b2-4835-91ce-b493ecd30481.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("de9282a1-0aa7-4ad8-a39a-58f19d05b651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1384, tv_nsec: 909167378 } })
92792024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92802024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
92812024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92822024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92832024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92842024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92852024-11-07T22:54:50.820ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19da6a5b-073a-4e12-8775-91fc61c1e962.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1384, tv_nsec: 909324282 } })
92862024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92872024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92882024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92892024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
92902024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
92912024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.288515ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
92922024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
92932024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.251324ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
92942024-11-07T22:54:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
92952024-11-07T22:54:50.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92962024-11-07T22:54:50.823ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.727321ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
92972024-11-07T22:54:50.823ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92982024-11-07T22:54:50.823ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1384, tv_nsec: 912810346 } })
92992024-11-07T22:54:50.823ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
93002024-11-07T22:54:50.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93012024-11-07T22:54:50.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93022024-11-07T22:54:50.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93032024-11-07T22:54:50.825ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93042024-11-07T22:54:50.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93052024-11-07T22:54:50.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
93062024-11-07T22:54:50.825ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
93072024-11-07T22:54:50.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
93082024-11-07T22:54:50.826ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93092024-11-07T22:54:50.828ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-07 22:44:50.819235001 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
93102024-11-07T22:54:50.828ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93112024-11-07T22:54:50.828ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.846409ms iteration = 13 status = {"expiration":"2024-11-07T22:44:50.819235001Z","pruned":[]}
93122024-11-07T22:54:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93132024-11-07T22:54:50.830ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93142024-11-07T22:54:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93152024-11-07T22:54:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
93162024-11-07T22:54:50.830ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93172024-11-07T22:54:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93182024-11-07T22:54:50.831ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
93192024-11-07T22:54:50.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93202024-11-07T22:54:50.831ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93212024-11-07T22:54:50.832ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1384, tv_nsec: 921142411 } })
93222024-11-07T22:54:50.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93232024-11-07T22:54:50.832ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
93242024-11-07T22:54:50.832ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93252024-11-07T22:54:50.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93262024-11-07T22:54:50.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.44322ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
93272024-11-07T22:54:50.834ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93282024-11-07T22:54:50.835ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.810076ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
93292024-11-07T22:54:50.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93302024-11-07T22:54:50.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
93312024-11-07T22:54:50.836ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93322024-11-07T22:54:50.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93332024-11-07T22:54:50.838ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93342024-11-07T22:54:50.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93352024-11-07T22:54:50.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93362024-11-07T22:54:50.840ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93372024-11-07T22:54:50.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93382024-11-07T22:54:50.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93392024-11-07T22:54:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
93402024-11-07T22:54:50.843ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93412024-11-07T22:54:50.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93422024-11-07T22:54:50.844ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93432024-11-07T22:54:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
93442024-11-07T22:54:50.845ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93452024-11-07T22:54:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93462024-11-07T22:54:50.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93472024-11-07T22:54:50.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93482024-11-07T22:54:50.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93492024-11-07T22:54:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
93502024-11-07T22:54:50.857ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93512024-11-07T22:54:50.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93522024-11-07T22:54:50.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93532024-11-07T22:54:50.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
93542024-11-07T22:54:50.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93552024-11-07T22:54:50.871ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93562024-11-07T22:54:50.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93572024-11-07T22:54:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93582024-11-07T22:54:50.874ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93592024-11-07T22:54:50.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93602024-11-07T22:54:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93612024-11-07T22:54:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
93622024-11-07T22:54:50.875ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93632024-11-07T22:54:50.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93642024-11-07T22:54:50.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.507872ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93652024-11-07T22:54:50.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.844221ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
93662024-11-07T22:54:50.879ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93672024-11-07T22:54:50.879ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
93682024-11-07T22:54:50.879ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93692024-11-07T22:54:50.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93702024-11-07T22:54:50.887ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93712024-11-07T22:54:50.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93722024-11-07T22:54:50.890ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93732024-11-07T22:54:50.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93742024-11-07T22:54:50.893ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
93752024-11-07T22:54:50.893ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
93762024-11-07T22:54:50.893ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
93772024-11-07T22:54:50.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
93782024-11-07T22:54:50.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93792024-11-07T22:54:50.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93802024-11-07T22:54:50.896ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
93812024-11-07T22:54:50.896ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
93822024-11-07T22:54:50.897ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 77.182282ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
93832024-11-07T22:54:50.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93842024-11-07T22:54:50.897ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93852024-11-07T22:54:50.897ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
93862024-11-07T22:54:50.897ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
93872024-11-07T22:54:50.897ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 77.43826ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
93882024-11-07T22:54:50.900ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
93892024-11-07T22:54:50.900ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93902024-11-07T22:54:50.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93912024-11-07T22:54:50.900ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93922024-11-07T22:54:50.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
93932024-11-07T22:54:50.903ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93942024-11-07T22:54:50.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93952024-11-07T22:54:50.903ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93962024-11-07T22:54:50.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
93972024-11-07T22:54:50.905ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
93982024-11-07T22:54:50.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
93992024-11-07T22:54:50.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 88.680763ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
94002024-11-07T22:54:50.916ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
94012024-11-07T22:54:50.916ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
94022024-11-07T22:54:50.916ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
94032024-11-07T22:54:50.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94042024-11-07T22:54:50.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94052024-11-07T22:54:50.936ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
94062024-11-07T22:54:50.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
94072024-11-07T22:54:50.951ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
94082024-11-07T22:54:50.987ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
94092024-11-07T22:54:50.996ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
94102024-11-07T22:54:50.996ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94112024-11-07T22:54:50.997ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "45819436-6559-45ea-8256-270cb2a3b1c9", "content-length": "26", "date": "Thu, 07 Nov 2024 22:54:50 GMT"} })
94122024-11-07T22:54:50.997ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94132024-11-07T22:54:51.001ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94142024-11-07T22:54:51.013ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
94152024-11-07T22:54:51.013ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94162024-11-07T22:54:51.013ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a038d46-918a-498e-b032-9510a26ab293", "content-length": "26", "date": "Thu, 07 Nov 2024 22:54:50 GMT"} })
94172024-11-07T22:54:51.013ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94182024-11-07T22:54:51.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94192024-11-07T22:54:51.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94202024-11-07T22:54:51.016ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94212024-11-07T22:54:51.039ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532/state
94222024-11-07T22:54:51.040ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "3505284b-b03b-4788-a8cb-bab23d949d5f", "content-length": "130", "date": "Thu, 07 Nov 2024 22:54:51 GMT"} })
94232024-11-07T22:54:51.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94242024-11-07T22:54:51.044ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 225.374991ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
94252024-11-07T22:54:51.045ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-07T22:54:48.963003093Z }, migration_in: None, migration_out: None } vmm_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
94262024-11-07T22:54:51.045ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2151 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 vmm_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-07T22:54:48.963003093Z }
94272024-11-07T22:54:51.045ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a roles = RoleSet { roles: {} } sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 vmm_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
94282024-11-07T22:54:51.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a resource = Database result = Ok(()) sled_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 vmm_id = b5cf5868-7c76-4d62-9b7a-b461419dc532
94292024-11-07T22:54:51.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
94302024-11-07T22:54:51.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94312024-11-07T22:54:51.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94322024-11-07T22:54:51.057ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94332024-11-07T22:54:51.057ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
94342024-11-07T22:54:51.057ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94352024-11-07T22:54:51.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94362024-11-07T22:54:51.058ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1385, tv_nsec: 147284974 } })
94372024-11-07T22:54:51.058ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
94382024-11-07T22:54:51.065ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 245.579727ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
94392024-11-07T22:54:51.065ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94402024-11-07T22:54:51.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94412024-11-07T22:54:51.066ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94422024-11-07T22:54:51.069ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94432024-11-07T22:54:51.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94442024-11-07T22:54:51.070ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 251.605199ms iteration = 6 status = {"nsuccess":5}
94452024-11-07T22:54:51.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94462024-11-07T22:54:51.072ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94472024-11-07T22:54:51.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94482024-11-07T22:54:51.074ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94492024-11-07T22:54:51.078ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
94502024-11-07T22:54:51.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94512024-11-07T22:54:51.078ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94522024-11-07T22:54:51.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94532024-11-07T22:54:51.081ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 261.490106ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
94542024-11-07T22:54:51.081ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94552024-11-07T22:54:51.082ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94562024-11-07T22:54:51.082ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94572024-11-07T22:54:51.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94582024-11-07T22:54:51.085ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94592024-11-07T22:54:51.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94602024-11-07T22:54:51.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94612024-11-07T22:54:51.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94622024-11-07T22:54:51.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94632024-11-07T22:54:51.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
94642024-11-07T22:54:51.086ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94652024-11-07T22:54:51.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94662024-11-07T22:54:51.090ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
94672024-11-07T22:54:51.090ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 271.312021ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
94682024-11-07T22:54:51.115ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
94692024-11-07T22:54:51.119ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94702024-11-07T22:54:51.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
94712024-11-07T22:54:51.124ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94722024-11-07T22:54:51.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94732024-11-07T22:54:51.126ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
94742024-11-07T22:54:51.126ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 0 version = 2
94752024-11-07T22:54:51.126ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94762024-11-07T22:54:51.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94772024-11-07T22:54:51.126ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 307.632061ms iteration = 25 status = 0
94782024-11-07T22:54:51.128ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94792024-11-07T22:54:51.131ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
94802024-11-07T22:54:51.131ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
94812024-11-07T22:54:51.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94822024-11-07T22:54:51.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94832024-11-07T22:54:51.131ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94842024-11-07T22:54:51.131ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
94852024-11-07T22:54:51.131ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 312.572914ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
94862024-11-07T22:54:51.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94872024-11-07T22:54:51.132ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94882024-11-07T22:54:51.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94892024-11-07T22:54:51.134ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94902024-11-07T22:54:51.134ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94912024-11-07T22:54:51.135ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 1 version = 2
94922024-11-07T22:54:51.135ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
94932024-11-07T22:54:51.135ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-07 22:43:11.643428 UTC dns_group = external generation = 2
94942024-11-07T22:54:51.135ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 315.630147ms iteration = 14 status = {"generation":2}
94952024-11-07T22:54:51.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94962024-11-07T22:54:51.138ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94972024-11-07T22:54:51.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94982024-11-07T22:54:51.140ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94992024-11-07T22:54:51.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95002024-11-07T22:54:51.140ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
95012024-11-07T22:54:51.140ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
95022024-11-07T22:54:51.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
95032024-11-07T22:54:51.141ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 322.745089ms iteration = 25 status = {}
95042024-11-07T22:54:51.142ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
95052024-11-07T22:54:51.142ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
95062024-11-07T22:54:51.142ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-07 22:43:11.086261 UTC dns_group = internal generation = 1
95072024-11-07T22:54:51.142ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 323.615832ms iteration = 14 status = {"generation":1}
95082024-11-07T22:54:51.146ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
95092024-11-07T22:54:51.146ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4ce1dfa8-d2ce-4d75-a9c5-fbe37c6a3a57", "date": "Thu, 07 Nov 2024 22:54:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95102024-11-07T22:54:51.146ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95112024-11-07T22:54:51.148ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "40e82d35-9a67-47dd-b323-d3705cb5b1b0", "date": "Thu, 07 Nov 2024 22:54:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95122024-11-07T22:54:51.148ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95132024-11-07T22:54:51.150ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95142024-11-07T22:54:51.150ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 331.372312ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
95152024-11-07T22:54:51.157ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
95162024-11-07T22:54:51.157ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 337.657881ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
95172024-11-07T22:54:51.157ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
95182024-11-07T22:54:51.158ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "346b5627-383b-4aff-8fb1-424869e13ee1", "content-length": "1", "date": "Thu, 07 Nov 2024 22:54:50 GMT"} })
95192024-11-07T22:54:51.160ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95202024-11-07T22:54:51.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95212024-11-07T22:54:51.162ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 343.238132ms iteration = 25 status = null
95222024-11-07T22:54:51.182ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-07T22:42:48.907310Z, time_modified: 2024-11-07T22:42:48.907310Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
95232024-11-07T22:54:51.182ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 362.994176ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]}},"default_endpoint":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
95242024-11-07T22:54:51.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95252024-11-07T22:54:51.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95262024-11-07T22:54:51.204ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95272024-11-07T22:54:51.206ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95282024-11-07T22:54:51.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95292024-11-07T22:54:51.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95302024-11-07T22:54:51.206ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
95312024-11-07T22:54:51.206ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95322024-11-07T22:54:51.206ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea6f3e6e-366b-452b-b867-6a31f67f86ae", "content-length": "26", "date": "Thu, 07 Nov 2024 22:54:50 GMT"} })
95332024-11-07T22:54:51.206ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95342024-11-07T22:54:51.208ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
95352024-11-07T22:54:51.208ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95362024-11-07T22:54:51.210ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95372024-11-07T22:54:51.210ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95382024-11-07T22:54:51.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95392024-11-07T22:54:51.217ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 398.425022ms iteration = 29 status = {"physical_disks_added":0}
95402024-11-07T22:54:51.233ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
95412024-11-07T22:54:51.233ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d480d2d4-e64e-45fd-83b5-718f5e0a934b", "date": "Thu, 07 Nov 2024 22:54:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95422024-11-07T22:54:51.233ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95432024-11-07T22:54:51.236ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "10c9fd03-102c-43dc-8c1d-278edcf9bd45", "date": "Thu, 07 Nov 2024 22:54:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95442024-11-07T22:54:51.236ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95452024-11-07T22:54:51.237ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6b8c8461-0e3c-4ea3-9bcb-9dfcad5b23f8", "date": "Thu, 07 Nov 2024 22:54:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95462024-11-07T22:54:51.237ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95472024-11-07T22:54:51.239ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95482024-11-07T22:54:51.239ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 420.368163ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
95492024-11-07T22:54:51.244ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
95502024-11-07T22:54:51.244ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95512024-11-07T22:54:51.244ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7765175-b8e5-435d-9cc7-69e361d07b2b", "content-length": "583", "date": "Thu, 07 Nov 2024 22:54:51 GMT"} })
95522024-11-07T22:54:51.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95532024-11-07T22:54:51.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95542024-11-07T22:54:51.298ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {86be4e76-66cd-4978-b88a-9d78e18c2cfd: {10.151.1.176: {670a3278-63eb-4d0f-9671-edf66650b9f3}, 10.151.1.175: {670a3278-63eb-4d0f-9671-edf66650b9f3}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
95552024-11-07T22:54:51.298ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
95562024-11-07T22:54:51.298ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "24440f47-ad6a-40be-b380-69d0027816a8", "date": "Thu, 07 Nov 2024 22:54:51 GMT"} })
95572024-11-07T22:54:51.298ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95582024-11-07T22:54:51.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95592024-11-07T22:54:51.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95602024-11-07T22:54:51.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95612024-11-07T22:54:51.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95622024-11-07T22:54:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95632024-11-07T22:54:51.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95642024-11-07T22:54:51.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95652024-11-07T22:54:51.311ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95662024-11-07T22:54:51.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95672024-11-07T22:54:51.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95682024-11-07T22:54:51.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95692024-11-07T22:54:51.324ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95702024-11-07T22:54:51.324ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95712024-11-07T22:54:51.324ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95722024-11-07T22:54:51.325ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ed2aca41-5894-48fd-9522-aeab1a8a8968", "date": "Thu, 07 Nov 2024 22:54:51 GMT"} })
95732024-11-07T22:54:51.327ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 507.487064ms iteration = 26 status = {}
95742024-11-07T22:54:51.374ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95752024-11-07T22:54:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95762024-11-07T22:54:51.377ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
95772024-11-07T22:54:51.377ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95782024-11-07T22:54:51.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95792024-11-07T22:54:51.380ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
95802024-11-07T22:54:51.380ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "19db825b-8fbe-4568-85c6-fbe40c2cbb6c", "content-length": "810", "date": "Thu, 07 Nov 2024 22:54:51 GMT"} })
95812024-11-07T22:54:51.380ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(6366755) }} sled = buskin
95822024-11-07T22:54:51.380ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
95832024-11-07T22:54:51.380ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
95842024-11-07T22:54:51.382ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 563.438804ms iteration = 25 status = {}
95852024-11-07T22:54:51.387ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
95862024-11-07T22:54:51.388ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3626a6ea-6eb2-49ce-9d88-93cc35dc57f8", "content-length": "134", "date": "Thu, 07 Nov 2024 22:54:50 GMT"} })
95872024-11-07T22:54:51.388ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
95882024-11-07T22:54:51.388ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
95892024-11-07T22:54:51.388ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
95902024-11-07T22:54:51.388ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
95912024-11-07T22:54:51.388ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95922024-11-07T22:54:51.388ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95932024-11-07T22:54:51.388ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95942024-11-07T22:54:51.388ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95952024-11-07T22:54:51.388ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95962024-11-07T22:54:51.388ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95972024-11-07T22:54:51.389ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
95982024-11-07T22:54:51.389ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95992024-11-07T22:54:51.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96002024-11-07T22:54:51.391ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
96012024-11-07T22:54:51.391ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f372ff1-b864-47a7-a01c-dadebdbb62fc", "content-length": "2", "date": "Thu, 07 Nov 2024 22:54:50 GMT"} })
96022024-11-07T22:54:51.391ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
96032024-11-07T22:54:51.392ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0761e80e-56a2-4429-a9bb-280bda04ca26", "content-length": "52", "date": "Thu, 07 Nov 2024 22:54:50 GMT"} })
96042024-11-07T22:54:51.392ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
96052024-11-07T22:54:51.392ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
96062024-11-07T22:54:51.529ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8f46e3f9-4c3a-4157-ae90-9afa93f327eb", "date": "Thu, 07 Nov 2024 22:54:51 GMT"} })
96072024-11-07T22:54:51.529ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
96082024-11-07T22:54:51.529ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
96092024-11-07T22:54:51.529ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d46dc2de-1cf4-4b40-8905-65109153ba3c", "content-length": "682", "date": "Thu, 07 Nov 2024 22:54:51 GMT"} })
96102024-11-07T22:54:51.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96112024-11-07T22:54:51.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96122024-11-07T22:54:51.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96132024-11-07T22:54:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96142024-11-07T22:54:51.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96152024-11-07T22:54:51.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96162024-11-07T22:54:51.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96172024-11-07T22:54:51.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96182024-11-07T22:54:51.548ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 729.756721ms iteration = 25 status = {}
96192024-11-07T22:54:51.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2e67090d-bea6-4908-9eb6-e46cd6463039 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96202024-11-07T22:54:51.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2e67090d-bea6-4908-9eb6-e46cd6463039 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96212024-11-07T22:54:51.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2e67090d-bea6-4908-9eb6-e46cd6463039 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96222024-11-07T22:54:51.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 127356fb-dd11-480f-b51b-78a25fd88687 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
96232024-11-07T22:54:51.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 127356fb-dd11-480f-b51b-78a25fd88687 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
96242024-11-07T22:54:51.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 127356fb-dd11-480f-b51b-78a25fd88687 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
96252024-11-07T22:54:51.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 288495f6-e4a6-4523-b1ca-6932b78e96e7 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
96262024-11-07T22:54:51.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 288495f6-e4a6-4523-b1ca-6932b78e96e7 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
96272024-11-07T22:54:51.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 288495f6-e4a6-4523-b1ca-6932b78e96e7 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
96282024-11-07T22:54:52.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4af052e2-9832-4c9a-a43c-6d24fd74f047 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96292024-11-07T22:54:52.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4af052e2-9832-4c9a-a43c-6d24fd74f047 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96302024-11-07T22:54:52.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2955 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4af052e2-9832-4c9a-a43c-6d24fd74f047 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96312024-11-07T22:54:53.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c4948271-9499-4b46-99d9-3d73f78c7a3e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96322024-11-07T22:54:53.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c4948271-9499-4b46-99d9-3d73f78c7a3e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96332024-11-07T22:54:53.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c4948271-9499-4b46-99d9-3d73f78c7a3e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96342024-11-07T22:54:54.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3261a598-91c2-4cef-aa17-5be8f8f03b85 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96352024-11-07T22:54:54.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3261a598-91c2-4cef-aa17-5be8f8f03b85 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96362024-11-07T22:54:54.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2625 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3261a598-91c2-4cef-aa17-5be8f8f03b85 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96372024-11-07T22:54:55.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bafc815b-bf0e-48ec-912f-e7308d797872 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96382024-11-07T22:54:55.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bafc815b-bf0e-48ec-912f-e7308d797872 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96392024-11-07T22:54:55.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bafc815b-bf0e-48ec-912f-e7308d797872 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96402024-11-07T22:54:56.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 72436122-60a8-402c-a674-5437b0e1c196 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96412024-11-07T22:54:56.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 72436122-60a8-402c-a674-5437b0e1c196 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96422024-11-07T22:54:56.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 72436122-60a8-402c-a674-5437b0e1c196 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96432024-11-07T22:54:57.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 50f19f7a-ac4d-4696-80b9-5c1675365f47 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96442024-11-07T22:54:57.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 50f19f7a-ac4d-4696-80b9-5c1675365f47 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96452024-11-07T22:54:57.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1835 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 50f19f7a-ac4d-4696-80b9-5c1675365f47 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96462024-11-07T22:54:58.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5d9906e7-e551-4aaf-a092-910e0ab9ffdf roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96472024-11-07T22:54:58.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5d9906e7-e551-4aaf-a092-910e0ab9ffdf resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96482024-11-07T22:54:58.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2538 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5d9906e7-e551-4aaf-a092-910e0ab9ffdf response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96492024-11-07T22:54:59.204ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 remote_addr = [fd00:1122:3344:101::1]:49347 req_id = af35a40d-d021-4fc7-bce8-a6a4ab652f04 uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-07T22:54:59.204360866Z }
96502024-11-07T22:54:59.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = af35a40d-d021-4fc7-bce8-a6a4ab652f04 roles = RoleSet { roles: {} } uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
96512024-11-07T22:54:59.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = af35a40d-d021-4fc7-bce8-a6a4ab652f04 resource = Database result = Ok(()) uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
96522024-11-07T22:54:59.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11524 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = af35a40d-d021-4fc7-bce8-a6a4ab652f04 response_code = 204 uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
96532024-11-07T22:54:59.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9a5a9846-e0d0-4d45-b4bc-57dbd17836e4 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96542024-11-07T22:54:59.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9a5a9846-e0d0-4d45-b4bc-57dbd17836e4 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96552024-11-07T22:54:59.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9a5a9846-e0d0-4d45-b4bc-57dbd17836e4 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96562024-11-07T22:55:00.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = aba59b21-7cd5-4948-bc67-e8487a61a21d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
96572024-11-07T22:55:00.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = aba59b21-7cd5-4948-bc67-e8487a61a21d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
96582024-11-07T22:55:00.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = aba59b21-7cd5-4948-bc67-e8487a61a21d response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
96592024-11-07T22:55:00.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = cfb5b82b-2005-4542-a96c-372e3aa9116a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
96602024-11-07T22:55:00.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = cfb5b82b-2005-4542-a96c-372e3aa9116a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
96612024-11-07T22:55:00.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = cfb5b82b-2005-4542-a96c-372e3aa9116a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
96622024-11-07T22:55:00.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
96632024-11-07T22:55:00.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
96642024-11-07T22:55:00.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96652024-11-07T22:55:00.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96662024-11-07T22:55:00.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96672024-11-07T22:55:00.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96682024-11-07T22:55:00.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96692024-11-07T22:55:00.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96702024-11-07T22:55:00.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96712024-11-07T22:55:00.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.417879ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96722024-11-07T22:55:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96732024-11-07T22:55:00.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96742024-11-07T22:55:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96752024-11-07T22:55:00.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96762024-11-07T22:55:00.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96772024-11-07T22:55:00.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96782024-11-07T22:55:00.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
96792024-11-07T22:55:00.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96802024-11-07T22:55:00.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96812024-11-07T22:55:00.841ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
96822024-11-07T22:55:00.841ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.186176ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
96832024-11-07T22:55:00.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8b67b353-d9a6-49cf-bbbd-cc7a8341af01 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96842024-11-07T22:55:00.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8b67b353-d9a6-49cf-bbbd-cc7a8341af01 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96852024-11-07T22:55:00.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8b67b353-d9a6-49cf-bbbd-cc7a8341af01 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
96862024-11-07T22:55:01.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = f15db63b-2af2-4bea-93be-4ddae7a9fd3a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
96872024-11-07T22:55:01.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = f15db63b-2af2-4bea-93be-4ddae7a9fd3a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
96882024-11-07T22:55:01.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3259 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = f15db63b-2af2-4bea-93be-4ddae7a9fd3a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
96892024-11-07T22:55:01.655ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2564 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 93ccfe17-09df-4f79-a110-4722ebfeacff response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
96902024-11-07T22:55:01.662ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-07T22:55:01.662114925Z }
96912024-11-07T22:55:01.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c roles = RoleSet { roles: {} } uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
96922024-11-07T22:55:01.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c resource = Database result = Ok(()) uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
96932024-11-07T22:55:01.700ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532 vmm_needs_update = true
96942024-11-07T22:55:01.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c roles = RoleSet { roles: {} } uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
96952024-11-07T22:55:01.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c resource = Database result = Ok(()) uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
96962024-11-07T22:55:01.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c roles = RoleSet { roles: {} } uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
96972024-11-07T22:55:01.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c resource = Database result = Ok(()) uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
96982024-11-07T22:55:01.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c roles = RoleSet { roles: {} } uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
96992024-11-07T22:55:01.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c resource = Database result = Ok(()) uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
97002024-11-07T22:55:01.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c roles = RoleSet { roles: {} } uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
97012024-11-07T22:55:01.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c resource = Database result = Ok(()) uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
97022024-11-07T22:55:01.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c roles = RoleSet { roles: {} } uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
97032024-11-07T22:55:01.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c resource = Database result = Ok(()) uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
97042024-11-07T22:55:01.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c roles = RoleSet { roles: {} } uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
97052024-11-07T22:55:01.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c resource = Database result = Ok(()) uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
97062024-11-07T22:55:01.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
97072024-11-07T22:55:01.714ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: a100cc61-90a7-48d2-ab79-09bcca41ca93, lookup_type: ById(a100cc61-90a7-48d2-ab79-09bcca41ca93) }, key: 2c95dca5-9f4e-4629-a4fe-9fdfeeeffbfc, lookup_type: ById(2c95dca5-9f4e-4629-a4fe-9fdfeeeffbfc) }, key: 6a504631-68b5-4b07-90c2-b9e9b949ee1a, lookup_type: ById(6a504631-68b5-4b07-90c2-b9e9b949ee1a) } result = Ok(()) uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
97082024-11-07T22:55:01.717ZINFOnexus (dropshot_internal): starting update saga for 6a504631-68b5-4b07-90c2-b9e9b949ee1a actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-07T22:55:01.662114925Z }
97092024-11-07T22:55:01.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54886 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c response_code = 204 uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
97102024-11-07T22:55:01.717ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8ff66a84-369e-46e2-81c1-4b6fd8830ca7 uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-07T22:55:01.662114925Z }
97112024-11-07T22:55:01.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8ff66a84-369e-46e2-81c1-4b6fd8830ca7 roles = RoleSet { roles: {} } uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
97122024-11-07T22:55:01.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8ff66a84-369e-46e2-81c1-4b6fd8830ca7 resource = Database result = Ok(()) uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
97132024-11-07T22:55:01.719ZDEBGnexus (dropshot_internal): preparing instance-update saga for 6a504631-68b5-4b07-90c2-b9e9b949ee1a... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 234aee60-2da6-4089-a4b8-bbd99650996c uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
97142024-11-07T22:55:01.719ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update
97152024-11-07T22:55:01.719ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"6a504631-68b5-4b07-90c2-b9e9b949ee1a","lookup_type":{"ById":"6a504631-68b5-4b07-90c2-b9e9b949ee1a"},"parent":{"key":"2c95dca5-9f4e-4629-a4fe-9fdfeeeffbfc","lookup_type":{"ById":"2c95dca5-9f4e-4629-a4fe-9fdfeeeffbfc"},"parent":{"key":"a100cc61-90a7-48d2-ab79-09bcca41ca93","lookup_type":{"ById":"a100cc61-90a7-48d2-ab79-09bcca41ca93"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97162024-11-07T22:55:01.719ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update
97172024-11-07T22:55:01.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3341 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8ff66a84-369e-46e2-81c1-4b6fd8830ca7 response_code = 204 uri = /vmms/b5cf5868-7c76-4d62-9b7a-b461419dc532
97182024-11-07T22:55:01.750ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update
97192024-11-07T22:55:01.750ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97202024-11-07T22:55:01.750ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97212024-11-07T22:55:01.750ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5
97222024-11-07T22:55:01.754ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97232024-11-07T22:55:01.754ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5
97242024-11-07T22:55:01.758ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97252024-11-07T22:55:01.758ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5
97262024-11-07T22:55:01.761ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97272024-11-07T22:55:01.761ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("5bbee1eb-03d7-41ac-a68a-d14eaaa38e92")) node_id = 0 saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5
97282024-11-07T22:55:01.765ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97292024-11-07T22:55:01.765ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5
97302024-11-07T22:55:01.773ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update
97312024-11-07T22:55:01.773ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance
97322024-11-07T22:55:01.773ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance
97332024-11-07T22:55:01.779ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance
97342024-11-07T22:55:01.780ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance
97352024-11-07T22:55:01.781ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance
97362024-11-07T22:55:01.782ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance
97372024-11-07T22:55:01.784ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance
97382024-11-07T22:55:01.784ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance
97392024-11-07T22:55:01.785ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance
97402024-11-07T22:55:01.785ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance
97412024-11-07T22:55:01.786ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance
97422024-11-07T22:55:01.786ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance
97432024-11-07T22:55:01.788ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance
97442024-11-07T22:55:01.791ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: a100cc61-90a7-48d2-ab79-09bcca41ca93, lookup_type: ById(a100cc61-90a7-48d2-ab79-09bcca41ca93) }, key: 2c95dca5-9f4e-4629-a4fe-9fdfeeeffbfc, lookup_type: ById(2c95dca5-9f4e-4629-a4fe-9fdfeeeffbfc) }, key: 6a504631-68b5-4b07-90c2-b9e9b949ee1a, lookup_type: ById(6a504631-68b5-4b07-90c2-b9e9b949ee1a) } result = Ok(()) saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance
97452024-11-07T22:55:01.791ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance updater_id = 5bbee1eb-03d7-41ac-a68a-d14eaaa38e92
97462024-11-07T22:55:01.791ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance
97472024-11-07T22:55:01.791ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance
97482024-11-07T22:55:01.800ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance updater_id = 5bbee1eb-03d7-41ac-a68a-d14eaaa38e92
97492024-11-07T22:55:01.800ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance
97502024-11-07T22:55:01.800ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance
97512024-11-07T22:55:01.804ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a locked_gen = Generation(Generation(2)) saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = LockInstance updater_id = 5bbee1eb-03d7-41ac-a68a-d14eaaa38e92
97522024-11-07T22:55:01.804ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97532024-11-07T22:55:01.804ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("5bbee1eb-03d7-41ac-a68a-d14eaaa38e92")}) node_id = 1 saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5
97542024-11-07T22:55:01.808ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97552024-11-07T22:55:01.808ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5
97562024-11-07T22:55:01.816ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
97572024-11-07T22:55:01.816ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
97582024-11-07T22:55:01.820ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
97592024-11-07T22:55:01.820ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
97602024-11-07T22:55:01.821ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
97612024-11-07T22:55:01.822ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
97622024-11-07T22:55:01.823ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
97632024-11-07T22:55:01.826ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: a100cc61-90a7-48d2-ab79-09bcca41ca93, lookup_type: ById(a100cc61-90a7-48d2-ab79-09bcca41ca93) }, key: 2c95dca5-9f4e-4629-a4fe-9fdfeeeffbfc, lookup_type: ById(2c95dca5-9f4e-4629-a4fe-9fdfeeeffbfc) }, key: 6a504631-68b5-4b07-90c2-b9e9b949ee1a, lookup_type: ById(6a504631-68b5-4b07-90c2-b9e9b949ee1a) } result = Ok(()) saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
97642024-11-07T22:55:01.826ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
97652024-11-07T22:55:01.826ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
97662024-11-07T22:55:01.836ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: b5cf5868-7c76-4d62-9b7a-b461419dc532, time_created: 2024-11-07T22:54:41.098387Z, time_deleted: None, instance_id: 6a504631-68b5-4b07-90c2-b9e9b949ee1a, sled_id: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-07T22:55:01.662114Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-07T22:54:38.983746Z, gen: Generation(Generation(3)), propolis_id: Some(b5cf5868-7c76-4d62-9b7a-b461419dc532), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(b5cf5868-7c76-4d62-9b7a-b461419dc532 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-07T22:55:01.834076516Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
97672024-11-07T22:55:01.841ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update
97682024-11-07T22:55:01.841ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"6a504631-68b5-4b07-90c2-b9e9b949ee1a","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"b5cf5868-7c76-4d62-9b7a-b461419dc532"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"6a504631-68b5-4b07-90c2-b9e9b949ee1a","lookup_type":{"ById":"6a504631-68b5-4b07-90c2-b9e9b949ee1a"},"parent":{"key":"2c95dca5-9f4e-4629-a4fe-9fdfeeeffbfc","lookup_type":{"ById":"2c95dca5-9f4e-4629-a4fe-9fdfeeeffbfc"},"parent":{"key":"a100cc61-90a7-48d2-ab79-09bcca41ca93","lookup_type":{"ById":"a100cc61-90a7-48d2-ab79-09bcca41ca93"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"5bbee1eb-03d7-41ac-a68a-d14eaaa38e92"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"2c95dca5-9f4e-4629-a4fe-9fdfeeeffbfc","ram_diff":1073741824},"destroy_active_vmm":"b5cf5868-7c76-4d62-9b7a-b461419dc532","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-07T22:55:01.834076516Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97692024-11-07T22:55:01.841ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update
97702024-11-07T22:55:01.846ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update
97712024-11-07T22:55:01.846ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97722024-11-07T22:55:01.846ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97732024-11-07T22:55:01.846ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
97742024-11-07T22:55:01.849ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97752024-11-07T22:55:01.849ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
97762024-11-07T22:55:01.853ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97772024-11-07T22:55:01.853ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
97782024-11-07T22:55:01.856ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97792024-11-07T22:55:01.856ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("da7bb3e0-f5b0-4a70-8a21-115d33334931")) node_id = 0 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
97802024-11-07T22:55:01.859ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97812024-11-07T22:55:01.859ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
97822024-11-07T22:55:01.863ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a parent_lock = UpdaterLock { updater_id: 5bbee1eb-03d7-41ac-a68a-d14eaaa38e92, locked_gen: Generation(Generation(2)) } saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update
97832024-11-07T22:55:01.863ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = BecomeUpdater
97842024-11-07T22:55:01.863ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = BecomeUpdater
97852024-11-07T22:55:01.874ZDEBGnexus (SagaExecutor): inherited lock from 5bbee1eb-03d7-41ac-a68a-d14eaaa38e92 to da7bb3e0-f5b0-4a70-8a21-115d33334931 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 5bbee1eb-03d7-41ac-a68a-d14eaaa38e92 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = BecomeUpdater updater_id = da7bb3e0-f5b0-4a70-8a21-115d33334931
97862024-11-07T22:55:01.874ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update
97872024-11-07T22:55:01.876ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97882024-11-07T22:55:01.876ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("da7bb3e0-f5b0-4a70-8a21-115d33334931")}) node_id = 1 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
97892024-11-07T22:55:01.879ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97902024-11-07T22:55:01.879ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
97912024-11-07T22:55:01.883ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97922024-11-07T22:55:01.883ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
97932024-11-07T22:55:01.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 798efbce-4844-4eaa-a7fa-3b5d492056b1 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
97942024-11-07T22:55:01.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 798efbce-4844-4eaa-a7fa-3b5d492056b1 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
97952024-11-07T22:55:01.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1800 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 798efbce-4844-4eaa-a7fa-3b5d492056b1 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
97962024-11-07T22:55:01.886ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
97972024-11-07T22:55:01.886ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
97982024-11-07T22:55:01.889ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update
97992024-11-07T22:55:01.889ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a
98002024-11-07T22:55:01.891ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = UpdateNetworkConfig
98012024-11-07T22:55:01.892ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = UpdateNetworkConfig
98022024-11-07T22:55:01.898ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = UpdateNetworkConfig
98032024-11-07T22:55:01.898ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = UpdateNetworkConfig
98042024-11-07T22:55:01.900ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
98052024-11-07T22:55:01.900ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = UpdateNetworkConfig
98062024-11-07T22:55:01.901ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = UpdateNetworkConfig
98072024-11-07T22:55:01.903ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
98082024-11-07T22:55:01.906ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
98092024-11-07T22:55:01.906ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
98102024-11-07T22:55:01.907ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
98112024-11-07T22:55:01.908ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
98122024-11-07T22:55:01.908ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
98132024-11-07T22:55:01.908ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
98142024-11-07T22:55:01.913ZDEBGnexus: notifying dendrite of updates instance_id = Some(6a504631-68b5-4b07-90c2-b9e9b949ee1a (instance)) switch = switch0
98152024-11-07T22:55:01.914ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1396, tv_nsec: 3429676 } })
98162024-11-07T22:55:01.914ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1114
98172024-11-07T22:55:01.944ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
98182024-11-07T22:55:01.944ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98192024-11-07T22:55:01.944ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4721573a-367b-4701-9e58-08af328cc268", "content-length": "26", "date": "Thu, 07 Nov 2024 22:55:01 GMT"} })
98202024-11-07T22:55:01.944ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98212024-11-07T22:55:01.945ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98222024-11-07T22:55:01.974ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
98232024-11-07T22:55:01.974ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a672c69-e0f5-48d5-9484-4b617bd14e8c", "content-length": "4", "date": "Thu, 07 Nov 2024 22:55:01 GMT"} })
98242024-11-07T22:55:01.975ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
98252024-11-07T22:55:01.975ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
98262024-11-07T22:55:01.978ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
98272024-11-07T22:55:01.978ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
98282024-11-07T22:55:01.984ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = ReleaseVirtualProvisioning
98292024-11-07T22:55:01.984ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = ReleaseVirtualProvisioning
98302024-11-07T22:55:01.997ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-07T22:55:01.987138Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 2c95dca5-9f4e-4629-a4fe-9fdfeeeffbfc, time_modified: Some(2024-11-07T22:55:01.987138Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, time_modified: Some(2024-11-07T22:55:01.987138Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update
98312024-11-07T22:55:01.997ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
98322024-11-07T22:55:01.997ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
98332024-11-07T22:55:02.000ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
98342024-11-07T22:55:02.000ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
98352024-11-07T22:55:02.004ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update
98362024-11-07T22:55:02.004ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = UnassignOximeterProducer
98372024-11-07T22:55:02.004ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = UnassignOximeterProducer
98382024-11-07T22:55:02.008ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 producer_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update
98392024-11-07T22:55:02.008ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = UnassignOximeterProducer
98402024-11-07T22:55:02.008ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = UnassignOximeterProducer
98412024-11-07T22:55:02.044ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:261 id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update
98422024-11-07T22:55:02.046ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 6a504631-68b5-4b07-90c2-b9e9b949ee1a saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/6a504631-68b5-4b07-90c2-b9e9b949ee1a
98432024-11-07T22:55:02.065ZDEBGnexus (SagaExecutor): client response oximeter-collector = 6a504631-68b5-4b07-90c2-b9e9b949ee1a result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/6a504631-68b5-4b07-90c2-b9e9b949ee1a", status: 204, headers: {"x-request-id": "db2b1950-704d-4c44-a72f-0a31fd33cf08", "date": "Thu, 07 Nov 2024 22:55:02 GMT"} }) saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update
98442024-11-07T22:55:02.065ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 producer_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update
98452024-11-07T22:55:02.066ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
98462024-11-07T22:55:02.066ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
98472024-11-07T22:55:02.070ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
98482024-11-07T22:55:02.070ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
98492024-11-07T22:55:02.073ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a lock = UpdaterLock { updater_id: da7bb3e0-f5b0-4a70-8a21-115d33334931, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-07T22:55:01.834076516Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update
98502024-11-07T22:55:02.073ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = CommitInstanceUpdates
98512024-11-07T22:55:02.073ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = CommitInstanceUpdates
98522024-11-07T22:55:02.108ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a new_runtime = InstanceRuntimeState { time_updated: 2024-11-07T22:55:01.834076516Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update
98532024-11-07T22:55:02.108ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
98542024-11-07T22:55:02.108ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
98552024-11-07T22:55:02.108ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
98562024-11-07T22:55:02.108ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
98572024-11-07T22:55:02.108ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
98582024-11-07T22:55:02.108ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98592024-11-07T22:55:02.108ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98602024-11-07T22:55:02.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98612024-11-07T22:55:02.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98622024-11-07T22:55:02.110ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98632024-11-07T22:55:02.112ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98642024-11-07T22:55:02.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98652024-11-07T22:55:02.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98662024-11-07T22:55:02.113ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
98672024-11-07T22:55:02.113ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
98682024-11-07T22:55:02.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98692024-11-07T22:55:02.115ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98702024-11-07T22:55:02.115ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98712024-11-07T22:55:02.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98722024-11-07T22:55:02.116ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
98732024-11-07T22:55:02.116ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("6a504631-68b5-4b07-90c2-b9e9b949ee1a"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b5cf5868-7c76-4d62-9b7a-b461419dc532")}) node_id = 7 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
98742024-11-07T22:55:02.119ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
98752024-11-07T22:55:02.119ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
98762024-11-07T22:55:02.123ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
98772024-11-07T22:55:02.123ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
98782024-11-07T22:55:02.127ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
98792024-11-07T22:55:02.127ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
98802024-11-07T22:55:02.130ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update
98812024-11-07T22:55:02.130ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = ReleaseSledResources
98822024-11-07T22:55:02.130ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = ReleaseSledResources
98832024-11-07T22:55:02.134ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
98842024-11-07T22:55:02.134ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
98852024-11-07T22:55:02.138ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
98862024-11-07T22:55:02.138ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
98872024-11-07T22:55:02.141ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a propolis_id = b5cf5868-7c76-4d62-9b7a-b461419dc532 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update
98882024-11-07T22:55:02.141ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = MarkVmmDeleted
98892024-11-07T22:55:02.141ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = MarkVmmDeleted
98902024-11-07T22:55:02.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 9fcfb881-1a83-4bbc-8ee0-279714ac02f3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
98912024-11-07T22:55:02.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 9fcfb881-1a83-4bbc-8ee0-279714ac02f3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
98922024-11-07T22:55:02.149ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
98932024-11-07T22:55:02.149ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
98942024-11-07T22:55:02.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 9fcfb881-1a83-4bbc-8ee0-279714ac02f3 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
98952024-11-07T22:55:02.153ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
98962024-11-07T22:55:02.153ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
98972024-11-07T22:55:02.156ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
98982024-11-07T22:55:02.156ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
98992024-11-07T22:55:02.159ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
99002024-11-07T22:55:02.159ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
99012024-11-07T22:55:02.162ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = ChainSuccessorSaga
99022024-11-07T22:55:02.162ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = ChainSuccessorSaga
99032024-11-07T22:55:02.164ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = ChainSuccessorSaga
99042024-11-07T22:55:02.164ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = ChainSuccessorSaga
99052024-11-07T22:55:02.192ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = ChainSuccessorSaga
99062024-11-07T22:55:02.192ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = ChainSuccessorSaga
99072024-11-07T22:55:02.193ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = ChainSuccessorSaga
99082024-11-07T22:55:02.197ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: a100cc61-90a7-48d2-ab79-09bcca41ca93, lookup_type: ById(a100cc61-90a7-48d2-ab79-09bcca41ca93) }, key: 2c95dca5-9f4e-4629-a4fe-9fdfeeeffbfc, lookup_type: ById(2c95dca5-9f4e-4629-a4fe-9fdfeeeffbfc) }, key: 6a504631-68b5-4b07-90c2-b9e9b949ee1a, lookup_type: ById(6a504631-68b5-4b07-90c2-b9e9b949ee1a) } result = Ok(()) saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = ChainSuccessorSaga
99092024-11-07T22:55:02.197ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = ChainSuccessorSaga
99102024-11-07T22:55:02.197ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_node = ChainSuccessorSaga
99112024-11-07T22:55:02.204ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
99122024-11-07T22:55:02.204ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99132024-11-07T22:55:02.205ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcf295a6-5d23-4f6e-bc63-6bc53ba96839", "content-length": "372", "date": "Thu, 07 Nov 2024 22:55:02 GMT"} })
99142024-11-07T22:55:02.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99152024-11-07T22:55:02.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99162024-11-07T22:55:02.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99172024-11-07T22:55:02.214ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update
99182024-11-07T22:55:02.214ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
99192024-11-07T22:55:02.214ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
99202024-11-07T22:55:02.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Signaled
99212024-11-07T22:55:02.214ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
99222024-11-07T22:55:02.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
99232024-11-07T22:55:02.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99242024-11-07T22:55:02.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
99252024-11-07T22:55:02.219ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
99262024-11-07T22:55:02.219ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
99272024-11-07T22:55:02.227ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
99282024-11-07T22:55:02.227ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
99292024-11-07T22:55:02.230ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
99302024-11-07T22:55:02.230ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e
99312024-11-07T22:55:02.249ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
99322024-11-07T22:55:02.249ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
99332024-11-07T22:55:02.250ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "480fc1d5-f164-4612-a396-69562578ed54", "date": "Thu, 07 Nov 2024 22:55:02 GMT"} })
99342024-11-07T22:55:02.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99352024-11-07T22:55:02.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99362024-11-07T22:55:02.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99372024-11-07T22:55:02.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99382024-11-07T22:55:02.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99392024-11-07T22:55:02.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99402024-11-07T22:55:02.258ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
99412024-11-07T22:55:02.258ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
99422024-11-07T22:55:02.258ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
99432024-11-07T22:55:02.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
99442024-11-07T22:55:02.258ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99452024-11-07T22:55:02.258ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99462024-11-07T22:55:02.259ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "57973cb1-c84f-4b90-8e1f-136a04cf71eb", "date": "Thu, 07 Nov 2024 22:55:02 GMT"} })
99472024-11-07T22:55:02.260ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 152.117015ms iteration = 27 status = {}
99482024-11-07T22:55:02.261ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
99492024-11-07T22:55:02.261ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
99502024-11-07T22:55:02.261ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
99512024-11-07T22:55:02.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
99522024-11-07T22:55:02.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99532024-11-07T22:55:02.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99542024-11-07T22:55:02.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99552024-11-07T22:55:02.275ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99562024-11-07T22:55:02.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99572024-11-07T22:55:02.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99582024-11-07T22:55:02.277ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99592024-11-07T22:55:02.279ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99602024-11-07T22:55:02.279ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99612024-11-07T22:55:02.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99622024-11-07T22:55:02.282ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
99632024-11-07T22:55:02.282ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e saga_name = instance-update saga_result = SagaResult { saga_id: 8fd512c5-9fd5-4ea3-bc93-696120a4042e, saga_log: SagaLog { saga_id: 8fd512c5-9fd5-4ea3-bc93-696120a4042e, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("da7bb3e0-f5b0-4a70-8a21-115d33334931")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("da7bb3e0-f5b0-4a70-8a21-115d33334931")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("6a504631-68b5-4b07-90c2-b9e9b949ee1a"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b5cf5868-7c76-4d62-9b7a-b461419dc532")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("6a504631-68b5-4b07-90c2-b9e9b949ee1a"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b5cf5868-7c76-4d62-9b7a-b461419dc532")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("da7bb3e0-f5b0-4a70-8a21-115d33334931"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("da7bb3e0-f5b0-4a70-8a21-115d33334931")}} }) }
99642024-11-07T22:55:02.282ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 8fd512c5-9fd5-4ea3-bc93-696120a4042e instance_id = 6a504631-68b5-4b07-90c2-b9e9b949ee1a saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update
99652024-11-07T22:55:02.282ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
99662024-11-07T22:55:02.282ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5
99672024-11-07T22:55:02.286ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
99682024-11-07T22:55:02.286ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5
99692024-11-07T22:55:02.289ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
99702024-11-07T22:55:02.289ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5
99712024-11-07T22:55:02.290ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
99722024-11-07T22:55:02.290ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
99732024-11-07T22:55:02.290ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 75.765465ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
99742024-11-07T22:55:02.293ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
99752024-11-07T22:55:02.293ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5
99762024-11-07T22:55:02.316ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99772024-11-07T22:55:02.317ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "33bef7cf-e61c-4ef3-87ba-5fdd9b16a3bf", "content-length": "691", "date": "Thu, 07 Nov 2024 22:55:02 GMT"} })
99782024-11-07T22:55:02.317ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
99792024-11-07T22:55:02.317ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
99802024-11-07T22:55:02.317ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
99812024-11-07T22:55:02.318ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 209.460722ms iteration = 26 status = {}
99822024-11-07T22:55:02.332ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update sec_id = 377e4941-a34d-4c51-b725-3cc833f8df14
99832024-11-07T22:55:02.332ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5 saga_name = start-instance-update saga_result = SagaResult { saga_id: ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5, saga_log: SagaLog { saga_id: ccc5dbd4-c4d5-44bc-ad7e-f7f736d030d5, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("5bbee1eb-03d7-41ac-a68a-d14eaaa38e92")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("5bbee1eb-03d7-41ac-a68a-d14eaaa38e92")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("5bbee1eb-03d7-41ac-a68a-d14eaaa38e92"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("5bbee1eb-03d7-41ac-a68a-d14eaaa38e92")}} }) }
99842024-11-07T22:55:02.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 741487ef-74d3-48af-91d9-fca79557bbae roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
99852024-11-07T22:55:02.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 741487ef-74d3-48af-91d9-fca79557bbae resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
99862024-11-07T22:55:02.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 741487ef-74d3-48af-91d9-fca79557bbae response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
99872024-11-07T22:55:03.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a8b77fb4-7d79-4c6a-b286-1357995a0e44 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
99882024-11-07T22:55:03.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a8b77fb4-7d79-4c6a-b286-1357995a0e44 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
99892024-11-07T22:55:03.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2686 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a8b77fb4-7d79-4c6a-b286-1357995a0e44 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
99902024-11-07T22:55:04.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 09058a00-6e0a-469a-bf44-8c35c7b289ef roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
99912024-11-07T22:55:04.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 09058a00-6e0a-469a-bf44-8c35c7b289ef resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
99922024-11-07T22:55:04.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 09058a00-6e0a-469a-bf44-8c35c7b289ef response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
99932024-11-07T22:55:05.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8658e59c-39ea-4be4-904d-366bb6e008e0 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
99942024-11-07T22:55:05.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8658e59c-39ea-4be4-904d-366bb6e008e0 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
99952024-11-07T22:55:05.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1922 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8658e59c-39ea-4be4-904d-366bb6e008e0 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
99962024-11-07T22:55:07.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0583c96d-04aa-400f-80a8-0bc180e7abb4 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
99972024-11-07T22:55:07.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0583c96d-04aa-400f-80a8-0bc180e7abb4 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
99982024-11-07T22:55:07.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0583c96d-04aa-400f-80a8-0bc180e7abb4 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
99992024-11-07T22:55:08.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1854700f-9340-46f1-8db1-8f8248798c0b roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100002024-11-07T22:55:08.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1854700f-9340-46f1-8db1-8f8248798c0b resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100012024-11-07T22:55:08.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1854700f-9340-46f1-8db1-8f8248798c0b response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100022024-11-07T22:55:09.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a044e7ca-0879-4990-83b8-8833188be146 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100032024-11-07T22:55:09.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a044e7ca-0879-4990-83b8-8833188be146 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100042024-11-07T22:55:09.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a044e7ca-0879-4990-83b8-8833188be146 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100052024-11-07T22:55:10.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 48ee8779-363c-4fb3-88d1-5fcafbcb85ae roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100062024-11-07T22:55:10.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 48ee8779-363c-4fb3-88d1-5fcafbcb85ae resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100072024-11-07T22:55:10.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2812 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 48ee8779-363c-4fb3-88d1-5fcafbcb85ae response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100082024-11-07T22:55:10.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
100092024-11-07T22:55:10.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
100102024-11-07T22:55:10.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100112024-11-07T22:55:10.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100122024-11-07T22:55:10.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100132024-11-07T22:55:10.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100142024-11-07T22:55:10.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100152024-11-07T22:55:10.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100162024-11-07T22:55:10.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100172024-11-07T22:55:10.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100182024-11-07T22:55:10.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100192024-11-07T22:55:10.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100202024-11-07T22:55:10.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100212024-11-07T22:55:10.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
100222024-11-07T22:55:10.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100232024-11-07T22:55:10.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100242024-11-07T22:55:10.839ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
100252024-11-07T22:55:10.839ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.435248ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
100262024-11-07T22:55:10.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100272024-11-07T22:55:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100282024-11-07T22:55:10.849ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.857453ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100292024-11-07T22:55:11.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dea464e3-96e5-452d-9ff2-b06226b0b0b6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100302024-11-07T22:55:11.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dea464e3-96e5-452d-9ff2-b06226b0b0b6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100312024-11-07T22:55:11.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dea464e3-96e5-452d-9ff2-b06226b0b0b6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100322024-11-07T22:55:12.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9649326a-460f-4d43-ae6e-3b608814c860 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100332024-11-07T22:55:12.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9649326a-460f-4d43-ae6e-3b608814c860 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100342024-11-07T22:55:12.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9649326a-460f-4d43-ae6e-3b608814c860 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100352024-11-07T22:55:13.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 11f1e446-6603-4401-b75d-8c40c31e3aef roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100362024-11-07T22:55:13.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 11f1e446-6603-4401-b75d-8c40c31e3aef resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100372024-11-07T22:55:13.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 11f1e446-6603-4401-b75d-8c40c31e3aef response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100382024-11-07T22:55:14.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 99392a47-88b1-4256-aeac-8e12ac8b3d42 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100392024-11-07T22:55:14.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 99392a47-88b1-4256-aeac-8e12ac8b3d42 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100402024-11-07T22:55:14.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 99392a47-88b1-4256-aeac-8e12ac8b3d42 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100412024-11-07T22:55:15.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5f7e609b-1e40-4d9a-92e4-ee0ae51167dd roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100422024-11-07T22:55:15.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5f7e609b-1e40-4d9a-92e4-ee0ae51167dd resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100432024-11-07T22:55:15.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1966 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5f7e609b-1e40-4d9a-92e4-ee0ae51167dd response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100442024-11-07T22:55:16.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4b7d32c0-381c-4864-bb09-c14421aecd1d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100452024-11-07T22:55:16.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4b7d32c0-381c-4864-bb09-c14421aecd1d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100462024-11-07T22:55:16.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2493 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4b7d32c0-381c-4864-bb09-c14421aecd1d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100472024-11-07T22:55:16.656ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1803 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 8a0a3f0c-bd48-4c6b-9f69-11f16f5b68ab response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
100482024-11-07T22:55:17.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = df794416-eeb9-4b27-a88f-3b747c82c092 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100492024-11-07T22:55:17.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = df794416-eeb9-4b27-a88f-3b747c82c092 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100502024-11-07T22:55:17.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = df794416-eeb9-4b27-a88f-3b747c82c092 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100512024-11-07T22:55:18.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = efc41a6a-7787-4f7f-8e44-9cfd1b99c9a6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100522024-11-07T22:55:18.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = efc41a6a-7787-4f7f-8e44-9cfd1b99c9a6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100532024-11-07T22:55:18.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2765 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = efc41a6a-7787-4f7f-8e44-9cfd1b99c9a6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100542024-11-07T22:55:19.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4a1b6fc7-f674-45f8-b6fa-368d77e80bcb roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100552024-11-07T22:55:19.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4a1b6fc7-f674-45f8-b6fa-368d77e80bcb resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100562024-11-07T22:55:19.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2472 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4a1b6fc7-f674-45f8-b6fa-368d77e80bcb response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100572024-11-07T22:55:20.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1e83b4ea-9379-40ee-8e5c-71e26ac0f471 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100582024-11-07T22:55:20.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1e83b4ea-9379-40ee-8e5c-71e26ac0f471 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100592024-11-07T22:55:20.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1e83b4ea-9379-40ee-8e5c-71e26ac0f471 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
100602024-11-07T22:55:20.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
100612024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
100622024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100632024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100642024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
100652024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
100662024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
100672024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100682024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
100692024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
100702024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100712024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100722024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
100732024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
100742024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
100752024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
100762024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100772024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
100782024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
100792024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
100802024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
100812024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
100822024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
100832024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
100842024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100852024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
100862024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
100872024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100882024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
100892024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100902024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
100912024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100922024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
100932024-11-07T22:55:20.819ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
100942024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100952024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100962024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100972024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100982024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
100992024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101002024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
101012024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101022024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
101032024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101042024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101052024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101062024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
101072024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101082024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101092024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101102024-11-07T22:55:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101112024-11-07T22:55:20.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101122024-11-07T22:55:20.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101132024-11-07T22:55:20.822ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.000381ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
101142024-11-07T22:55:20.822ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101152024-11-07T22:55:20.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101162024-11-07T22:55:20.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
101172024-11-07T22:55:20.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101182024-11-07T22:55:20.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101192024-11-07T22:55:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101202024-11-07T22:55:20.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101212024-11-07T22:55:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101222024-11-07T22:55:20.826ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101232024-11-07T22:55:20.826ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1414, tv_nsec: 915520830 } })
101242024-11-07T22:55:20.826ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
101252024-11-07T22:55:20.827ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.025277ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
101262024-11-07T22:55:20.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101272024-11-07T22:55:20.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
101282024-11-07T22:55:20.828ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101292024-11-07T22:55:20.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101302024-11-07T22:55:20.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101312024-11-07T22:55:20.829ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101322024-11-07T22:55:20.830ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101332024-11-07T22:55:20.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101342024-11-07T22:55:20.830ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1414, tv_nsec: 919254980 } })
101352024-11-07T22:55:20.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101362024-11-07T22:55:20.830ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
101372024-11-07T22:55:20.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101382024-11-07T22:55:20.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101392024-11-07T22:55:20.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101402024-11-07T22:55:20.833ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1414, tv_nsec: 922678173 } })
101412024-11-07T22:55:20.833ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
101422024-11-07T22:55:20.834ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101432024-11-07T22:55:20.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101442024-11-07T22:55:20.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.518679ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101452024-11-07T22:55:20.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101462024-11-07T22:55:20.835ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101472024-11-07T22:55:20.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101482024-11-07T22:55:20.836ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101492024-11-07T22:55:20.837ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101502024-11-07T22:55:20.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101512024-11-07T22:55:20.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101522024-11-07T22:55:20.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101532024-11-07T22:55:20.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101542024-11-07T22:55:20.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 34.84347ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
101552024-11-07T22:55:20.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101562024-11-07T22:55:20.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101572024-11-07T22:55:20.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 37.43984ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
101582024-11-07T22:55:20.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101592024-11-07T22:55:20.861ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101602024-11-07T22:55:20.861ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
101612024-11-07T22:55:20.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101622024-11-07T22:55:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101632024-11-07T22:55:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101642024-11-07T22:55:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101652024-11-07T22:55:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101662024-11-07T22:55:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101672024-11-07T22:55:20.864ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101682024-11-07T22:55:20.864ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
101692024-11-07T22:55:20.864ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101702024-11-07T22:55:20.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101712024-11-07T22:55:20.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
101722024-11-07T22:55:20.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101732024-11-07T22:55:20.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101742024-11-07T22:55:20.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 47.006369ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
101752024-11-07T22:55:20.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101762024-11-07T22:55:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101772024-11-07T22:55:20.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101782024-11-07T22:55:20.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101792024-11-07T22:55:20.875ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101802024-11-07T22:55:20.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101812024-11-07T22:55:20.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101822024-11-07T22:55:20.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
101832024-11-07T22:55:20.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101842024-11-07T22:55:20.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101852024-11-07T22:55:20.876ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
101862024-11-07T22:55:20.876ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 57.702057ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
101872024-11-07T22:55:20.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101882024-11-07T22:55:20.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101892024-11-07T22:55:20.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101902024-11-07T22:55:20.892ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
101912024-11-07T22:55:20.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101922024-11-07T22:55:20.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101932024-11-07T22:55:20.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101942024-11-07T22:55:20.897ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
101952024-11-07T22:55:20.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101962024-11-07T22:55:20.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101972024-11-07T22:55:20.900ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
101982024-11-07T22:55:20.900ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.325285ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
101992024-11-07T22:55:20.910ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102002024-11-07T22:55:20.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102012024-11-07T22:55:20.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 96.226106ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
102022024-11-07T22:55:20.923ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
102032024-11-07T22:55:20.923ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102042024-11-07T22:55:20.924ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0240fd9a-b85e-408e-a111-9b5cc851f776", "content-length": "26", "date": "Thu, 07 Nov 2024 22:55:20 GMT"} })
102052024-11-07T22:55:20.924ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102062024-11-07T22:55:20.926ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102072024-11-07T22:55:20.929ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102082024-11-07T22:55:20.929ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
102092024-11-07T22:55:20.929ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 110.4139ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
102102024-11-07T22:55:20.955ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 136.72704ms iteration = 30 status = {"physical_disks_added":0}
102112024-11-07T22:55:20.971ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
102122024-11-07T22:55:20.971ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102132024-11-07T22:55:20.972ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "95142fcc-86f1-4c9c-b51d-c5665db408c3", "content-length": "26", "date": "Thu, 07 Nov 2024 22:55:20 GMT"} })
102142024-11-07T22:55:20.972ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102152024-11-07T22:55:20.974ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102162024-11-07T22:55:21.024ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
102172024-11-07T22:55:21.024ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102182024-11-07T22:55:21.024ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "568ff684-ee3d-49d1-8d17-98c50cff8843", "content-length": "26", "date": "Thu, 07 Nov 2024 22:55:20 GMT"} })
102192024-11-07T22:55:21.024ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102202024-11-07T22:55:21.026ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
102212024-11-07T22:55:21.061ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 242.269478ms iteration = 26 status = {}
102222024-11-07T22:55:21.068ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
102232024-11-07T22:55:21.068ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102242024-11-07T22:55:21.069ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "61fd834b-b66a-475a-94c3-0578235860e3", "content-length": "372", "date": "Thu, 07 Nov 2024 22:55:21 GMT"} })
102252024-11-07T22:55:21.069ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102262024-11-07T22:55:21.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102272024-11-07T22:55:21.071ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102282024-11-07T22:55:21.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102292024-11-07T22:55:21.095ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
102302024-11-07T22:55:21.095ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3071cd3f-a947-428a-a381-787effc8443e", "content-length": "2", "date": "Thu, 07 Nov 2024 22:55:20 GMT"} })
102312024-11-07T22:55:21.100ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102322024-11-07T22:55:21.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102332024-11-07T22:55:21.108ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
102342024-11-07T22:55:21.109ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a97aaea9-d808-43d6-9745-cf25636edb2c", "content-length": "691", "date": "Thu, 07 Nov 2024 22:55:21 GMT"} })
102352024-11-07T22:55:21.109ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
102362024-11-07T22:55:21.109ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
102372024-11-07T22:55:21.109ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
102382024-11-07T22:55:21.111ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 292.250486ms iteration = 27 status = {}
102392024-11-07T22:55:21.111ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102402024-11-07T22:55:21.112ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 293.642064ms iteration = 26 status = null
102412024-11-07T22:55:21.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
102422024-11-07T22:55:21.114ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102432024-11-07T22:55:21.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102442024-11-07T22:55:21.116ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 297.824827ms iteration = 26 status = 0
102452024-11-07T22:55:21.159ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
102462024-11-07T22:55:21.159ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
102472024-11-07T22:55:21.160ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5cdb9944-9332-4366-a7f7-6bc34eb084fd", "date": "Thu, 07 Nov 2024 22:55:21 GMT"} })
102482024-11-07T22:55:21.160ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102492024-11-07T22:55:21.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102502024-11-07T22:55:21.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102512024-11-07T22:55:21.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102522024-11-07T22:55:21.165ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102532024-11-07T22:55:21.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102542024-11-07T22:55:21.168ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
102552024-11-07T22:55:21.168ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102562024-11-07T22:55:21.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102572024-11-07T22:55:21.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102582024-11-07T22:55:21.181ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
102592024-11-07T22:55:21.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102602024-11-07T22:55:21.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102612024-11-07T22:55:21.191ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
102622024-11-07T22:55:21.191ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d2ec622-b893-4b35-9ebe-b05c960d78a2", "content-length": "134", "date": "Thu, 07 Nov 2024 22:55:21 GMT"} })
102632024-11-07T22:55:21.191ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
102642024-11-07T22:55:21.191ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
102652024-11-07T22:55:21.192ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
102662024-11-07T22:55:21.192ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
102672024-11-07T22:55:21.192ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102682024-11-07T22:55:21.192ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102692024-11-07T22:55:21.192ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102702024-11-07T22:55:21.192ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102712024-11-07T22:55:21.192ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102722024-11-07T22:55:21.192ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102732024-11-07T22:55:21.192ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
102742024-11-07T22:55:21.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102752024-11-07T22:55:21.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102762024-11-07T22:55:21.194ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
102772024-11-07T22:55:21.195ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bf552f6-32e5-4d61-8ca7-fc19e248b625", "content-length": "2", "date": "Thu, 07 Nov 2024 22:55:21 GMT"} })
102782024-11-07T22:55:21.195ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
102792024-11-07T22:55:21.195ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cd98a97-ece6-4eed-a5ef-e4e9893c0109", "content-length": "52", "date": "Thu, 07 Nov 2024 22:55:21 GMT"} })
102802024-11-07T22:55:21.195ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
102812024-11-07T22:55:21.195ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
102822024-11-07T22:55:21.283ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "02f35d55-c0b1-436b-b038-33ee4e948721", "date": "Thu, 07 Nov 2024 22:55:21 GMT"} })
102832024-11-07T22:55:21.285ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 466.514308ms iteration = 28 status = {}
102842024-11-07T22:55:21.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5c63d523-e64e-47c5-bd2c-b59ae7520a1f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
102852024-11-07T22:55:21.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5c63d523-e64e-47c5-bd2c-b59ae7520a1f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
102862024-11-07T22:55:21.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5c63d523-e64e-47c5-bd2c-b59ae7520a1f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
102872024-11-07T22:55:21.393ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c2680858-4cb5-427f-b98d-719a83beb3ee", "date": "Thu, 07 Nov 2024 22:55:21 GMT"} })
102882024-11-07T22:55:21.393ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
102892024-11-07T22:55:21.393ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
102902024-11-07T22:55:21.397ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec599e49-0856-4e9d-8a5f-02e64b5974b3", "content-length": "682", "date": "Thu, 07 Nov 2024 22:55:21 GMT"} })
102912024-11-07T22:55:21.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102922024-11-07T22:55:21.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102932024-11-07T22:55:21.401ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102942024-11-07T22:55:21.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102952024-11-07T22:55:21.404ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102962024-11-07T22:55:21.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102972024-11-07T22:55:21.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102982024-11-07T22:55:21.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102992024-11-07T22:55:21.414ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 595.17762ms iteration = 26 status = {}
103002024-11-07T22:55:21.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = f02752d1-b04c-4d54-a9a0-e9059b6b66c8 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
103012024-11-07T22:55:21.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = f02752d1-b04c-4d54-a9a0-e9059b6b66c8 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
103022024-11-07T22:55:21.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = f02752d1-b04c-4d54-a9a0-e9059b6b66c8 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
103032024-11-07T22:55:21.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 49e37c84-4d0d-455c-b53c-10af8128a8ae roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
103042024-11-07T22:55:21.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 49e37c84-4d0d-455c-b53c-10af8128a8ae resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
103052024-11-07T22:55:21.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 49e37c84-4d0d-455c-b53c-10af8128a8ae response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
103062024-11-07T22:55:22.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 47144f8b-eae5-4477-92f3-fb3c3b4bea3f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103072024-11-07T22:55:22.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 47144f8b-eae5-4477-92f3-fb3c3b4bea3f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103082024-11-07T22:55:22.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2785 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 47144f8b-eae5-4477-92f3-fb3c3b4bea3f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103092024-11-07T22:55:23.373ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:47995
103102024-11-07T22:55:23.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47995 req_id = 1a37969b-85e4-4480-a5fb-4be7d8a5fdc6 roles = RoleSet { roles: {} } uri = /metrics/producers
103112024-11-07T22:55:23.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47995 req_id = 1a37969b-85e4-4480-a5fb-4be7d8a5fdc6 resource = Database result = Ok(()) uri = /metrics/producers
103122024-11-07T22:55:23.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1ab379a5-9a4d-4776-976b-6c35dd6dd086 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103132024-11-07T22:55:23.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1ab379a5-9a4d-4776-976b-6c35dd6dd086 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103142024-11-07T22:55:23.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1ab379a5-9a4d-4776-976b-6c35dd6dd086 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103152024-11-07T22:55:23.408ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103162024-11-07T22:55:23.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35157 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47995 req_id = 1a37969b-85e4-4480-a5fb-4be7d8a5fdc6 response_code = 201 uri = /metrics/producers
103172024-11-07T22:55:24.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 37baa4cc-7f25-45ab-84b3-c1a99bcf1620 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103182024-11-07T22:55:24.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 37baa4cc-7f25-45ab-84b3-c1a99bcf1620 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103192024-11-07T22:55:24.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 37baa4cc-7f25-45ab-84b3-c1a99bcf1620 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103202024-11-07T22:55:25.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bdd6fcba-b95c-4806-af94-73b62e922c89 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103212024-11-07T22:55:25.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bdd6fcba-b95c-4806-af94-73b62e922c89 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103222024-11-07T22:55:25.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2842 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bdd6fcba-b95c-4806-af94-73b62e922c89 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103232024-11-07T22:55:26.418ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:61101
103242024-11-07T22:55:26.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61101 req_id = 8105efb5-ff9b-4daf-961b-10b1de155fe2 roles = RoleSet { roles: {} } uri = /metrics/producers
103252024-11-07T22:55:26.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61101 req_id = 8105efb5-ff9b-4daf-961b-10b1de155fe2 resource = Database result = Ok(()) uri = /metrics/producers
103262024-11-07T22:55:26.455ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 9e471274-19dd-4f92-b383-47c4daa65273
103272024-11-07T22:55:26.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37673 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61101 req_id = 8105efb5-ff9b-4daf-961b-10b1de155fe2 response_code = 201 uri = /metrics/producers
103282024-11-07T22:55:26.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d738b3a1-a814-4974-9cf3-eb8f3db5580d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103292024-11-07T22:55:26.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d738b3a1-a814-4974-9cf3-eb8f3db5580d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103302024-11-07T22:55:26.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2302 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d738b3a1-a814-4974-9cf3-eb8f3db5580d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103312024-11-07T22:55:27.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1ebd6c77-9b7e-479b-a242-7e1ab648887f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103322024-11-07T22:55:27.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1ebd6c77-9b7e-479b-a242-7e1ab648887f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103332024-11-07T22:55:27.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2521 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1ebd6c77-9b7e-479b-a242-7e1ab648887f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103342024-11-07T22:55:27.793ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:64574
103352024-11-07T22:55:27.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64574 req_id = aa5a2cbf-76ba-457c-8368-e94198c87157 roles = RoleSet { roles: {} } uri = /metrics/producers
103362024-11-07T22:55:27.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64574 req_id = aa5a2cbf-76ba-457c-8368-e94198c87157 resource = Database result = Ok(()) uri = /metrics/producers
103372024-11-07T22:55:27.832ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 815e7211-42cf-4415-8116-29d4376e1760
103382024-11-07T22:55:27.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38245 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64574 req_id = aa5a2cbf-76ba-457c-8368-e94198c87157 response_code = 201 uri = /metrics/producers
103392024-11-07T22:55:28.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a3b93f68-ed36-4799-ba02-143757f03cf5 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103402024-11-07T22:55:28.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a3b93f68-ed36-4799-ba02-143757f03cf5 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103412024-11-07T22:55:28.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2655 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a3b93f68-ed36-4799-ba02-143757f03cf5 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103422024-11-07T22:55:29.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 02d70eb2-23bc-46dc-8578-e2a9d7a38325 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103432024-11-07T22:55:29.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 02d70eb2-23bc-46dc-8578-e2a9d7a38325 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103442024-11-07T22:55:29.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2519 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 02d70eb2-23bc-46dc-8578-e2a9d7a38325 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103452024-11-07T22:55:30.070ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:43441
103462024-11-07T22:55:30.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43441 req_id = d53f38ae-44e6-4a4f-96fb-f93d52894636 roles = RoleSet { roles: {} } uri = /metrics/producers
103472024-11-07T22:55:30.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43441 req_id = d53f38ae-44e6-4a4f-96fb-f93d52894636 resource = Database result = Ok(()) uri = /metrics/producers
103482024-11-07T22:55:30.080ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 43a27374-6630-4b8d-a3e3-a2857df923bd
103492024-11-07T22:55:30.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10372 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43441 req_id = d53f38ae-44e6-4a4f-96fb-f93d52894636 response_code = 201 uri = /metrics/producers
103502024-11-07T22:55:30.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c8b8afc0-d8ac-46e6-972e-7f5874482504 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103512024-11-07T22:55:30.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c8b8afc0-d8ac-46e6-972e-7f5874482504 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103522024-11-07T22:55:30.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c8b8afc0-d8ac-46e6-972e-7f5874482504 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103532024-11-07T22:55:30.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
103542024-11-07T22:55:30.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
103552024-11-07T22:55:30.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103562024-11-07T22:55:30.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103572024-11-07T22:55:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103582024-11-07T22:55:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103592024-11-07T22:55:30.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103602024-11-07T22:55:30.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103612024-11-07T22:55:30.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103622024-11-07T22:55:30.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103632024-11-07T22:55:30.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103642024-11-07T22:55:30.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103652024-11-07T22:55:30.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103662024-11-07T22:55:30.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103672024-11-07T22:55:30.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103682024-11-07T22:55:30.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
103692024-11-07T22:55:30.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103702024-11-07T22:55:30.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103712024-11-07T22:55:30.874ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
103722024-11-07T22:55:30.874ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.277518ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
103732024-11-07T22:55:30.886ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.936873ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103742024-11-07T22:55:31.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e6f0e88a-8277-41c5-b4f2-aa08c4d4268e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103752024-11-07T22:55:31.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e6f0e88a-8277-41c5-b4f2-aa08c4d4268e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103762024-11-07T22:55:31.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e6f0e88a-8277-41c5-b4f2-aa08c4d4268e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103772024-11-07T22:55:31.655ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1651 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 38149c2a-ba8d-4c8e-b9ff-5cae2bd40463 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
103782024-11-07T22:55:32.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = dd4ed18c-82f9-4c78-a019-2392351b913b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
103792024-11-07T22:55:32.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = dd4ed18c-82f9-4c78-a019-2392351b913b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
103802024-11-07T22:55:32.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = dd4ed18c-82f9-4c78-a019-2392351b913b response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
103812024-11-07T22:55:32.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f764cfc7-e92b-46e8-83b8-b5f4a34485a6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103822024-11-07T22:55:32.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f764cfc7-e92b-46e8-83b8-b5f4a34485a6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103832024-11-07T22:55:32.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1668 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f764cfc7-e92b-46e8-83b8-b5f4a34485a6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103842024-11-07T22:55:33.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 583e8fba-0093-465a-9b6f-42394309b252 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103852024-11-07T22:55:33.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 583e8fba-0093-465a-9b6f-42394309b252 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103862024-11-07T22:55:33.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 583e8fba-0093-465a-9b6f-42394309b252 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103872024-11-07T22:55:34.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c5f8a2eb-e79b-44e0-8db3-68bc0a120654 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103882024-11-07T22:55:34.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c5f8a2eb-e79b-44e0-8db3-68bc0a120654 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103892024-11-07T22:55:34.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c5f8a2eb-e79b-44e0-8db3-68bc0a120654 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103902024-11-07T22:55:35.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1fd1e8f3-4e28-4f3d-8aba-f08cd8349fa7 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103912024-11-07T22:55:35.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1fd1e8f3-4e28-4f3d-8aba-f08cd8349fa7 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103922024-11-07T22:55:35.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1fd1e8f3-4e28-4f3d-8aba-f08cd8349fa7 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103932024-11-07T22:55:36.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7b968cc2-022e-4e6d-a202-dc3838dbdaf3 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103942024-11-07T22:55:36.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7b968cc2-022e-4e6d-a202-dc3838dbdaf3 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103952024-11-07T22:55:36.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7b968cc2-022e-4e6d-a202-dc3838dbdaf3 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103962024-11-07T22:55:37.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1a0344d6-d39d-4a6f-9a59-42f23de1d6ab roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103972024-11-07T22:55:37.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1a0344d6-d39d-4a6f-9a59-42f23de1d6ab resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103982024-11-07T22:55:37.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1990 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1a0344d6-d39d-4a6f-9a59-42f23de1d6ab response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
103992024-11-07T22:55:38.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4c6fa4dc-4e60-4150-9c2d-b2342a5a8e6e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104002024-11-07T22:55:38.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4c6fa4dc-4e60-4150-9c2d-b2342a5a8e6e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104012024-11-07T22:55:38.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4c6fa4dc-4e60-4150-9c2d-b2342a5a8e6e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104022024-11-07T22:55:39.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 742b28fb-7dfd-47f0-bb00-14cd7c574dd3 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104032024-11-07T22:55:39.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 742b28fb-7dfd-47f0-bb00-14cd7c574dd3 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104042024-11-07T22:55:39.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2464 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 742b28fb-7dfd-47f0-bb00-14cd7c574dd3 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104052024-11-07T22:55:40.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 43e086a1-c1aa-4f23-afab-70c715f0d138 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104062024-11-07T22:55:40.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 43e086a1-c1aa-4f23-afab-70c715f0d138 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104072024-11-07T22:55:40.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 43e086a1-c1aa-4f23-afab-70c715f0d138 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104082024-11-07T22:55:40.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
104092024-11-07T22:55:40.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
104102024-11-07T22:55:40.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104112024-11-07T22:55:40.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104122024-11-07T22:55:40.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104132024-11-07T22:55:40.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104142024-11-07T22:55:40.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104152024-11-07T22:55:40.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104162024-11-07T22:55:40.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104172024-11-07T22:55:40.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104182024-11-07T22:55:40.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104192024-11-07T22:55:40.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104202024-11-07T22:55:40.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104212024-11-07T22:55:40.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
104222024-11-07T22:55:40.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104232024-11-07T22:55:40.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104242024-11-07T22:55:40.847ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
104252024-11-07T22:55:40.847ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.169921ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
104262024-11-07T22:55:40.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104272024-11-07T22:55:40.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104282024-11-07T22:55:40.879ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.501882ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104292024-11-07T22:55:41.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bea4bbdb-7fbd-47e2-abea-427e84170fb3 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104302024-11-07T22:55:41.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bea4bbdb-7fbd-47e2-abea-427e84170fb3 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104312024-11-07T22:55:41.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2040 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bea4bbdb-7fbd-47e2-abea-427e84170fb3 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104322024-11-07T22:55:42.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9974e0fb-f080-4ec8-bc44-ba88ae1da06c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104332024-11-07T22:55:42.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9974e0fb-f080-4ec8-bc44-ba88ae1da06c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104342024-11-07T22:55:42.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2301 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9974e0fb-f080-4ec8-bc44-ba88ae1da06c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104352024-11-07T22:55:42.886ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
104362024-11-07T22:55:42.886ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
104372024-11-07T22:55:42.917ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
104382024-11-07T22:55:42.917ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:49524
104392024-11-07T22:55:42.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:49524 req_id = 36cc70c9-7241-433e-ad3d-57cabb6ef50e roles = RoleSet { roles: {} } uri = /metrics/producers
104402024-11-07T22:55:42.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:49524 req_id = 36cc70c9-7241-433e-ad3d-57cabb6ef50e resource = Database result = Ok(()) uri = /metrics/producers
104412024-11-07T22:55:42.926ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 377e4941-a34d-4c51-b725-3cc833f8df14
104422024-11-07T22:55:42.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8332 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:49524 req_id = 36cc70c9-7241-433e-ad3d-57cabb6ef50e response_code = 201 uri = /metrics/producers
104432024-11-07T22:55:42.926ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "36cc70c9-7241-433e-ad3d-57cabb6ef50e", "content-length": "41", "date": "Thu, 07 Nov 2024 22:55:42 GMT"} })
104442024-11-07T22:55:42.927ZDEBGnexus (producer-registration-task): registered with nexus successfully
104452024-11-07T22:55:42.927ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
104462024-11-07T22:55:43.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2ba4c332-a86d-479d-9652-1b04c44238f9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104472024-11-07T22:55:43.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2ba4c332-a86d-479d-9652-1b04c44238f9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104482024-11-07T22:55:43.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2ba4c332-a86d-479d-9652-1b04c44238f9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104492024-11-07T22:55:44.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 46d3b495-bad2-49cb-9c9d-3428e428697a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104502024-11-07T22:55:44.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 46d3b495-bad2-49cb-9c9d-3428e428697a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104512024-11-07T22:55:44.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6551 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 46d3b495-bad2-49cb-9c9d-3428e428697a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104522024-11-07T22:55:45.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 99d3cc22-36dd-4589-bdaf-61264550d52f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104532024-11-07T22:55:45.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 99d3cc22-36dd-4589-bdaf-61264550d52f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104542024-11-07T22:55:45.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2551 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 99d3cc22-36dd-4589-bdaf-61264550d52f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104552024-11-07T22:55:46.654ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1506 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 1cb0fd24-c05d-4a01-8c9a-22752bbb75bb response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
104562024-11-07T22:55:46.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a9ee1f14-d324-4dd2-a87b-76ee65745cb0 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104572024-11-07T22:55:46.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a9ee1f14-d324-4dd2-a87b-76ee65745cb0 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104582024-11-07T22:55:46.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2343 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = a9ee1f14-d324-4dd2-a87b-76ee65745cb0 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104592024-11-07T22:55:47.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0dd208d4-9cdd-4078-ad19-6432c5f5dbd8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104602024-11-07T22:55:47.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0dd208d4-9cdd-4078-ad19-6432c5f5dbd8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104612024-11-07T22:55:47.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2494 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0dd208d4-9cdd-4078-ad19-6432c5f5dbd8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104622024-11-07T22:55:48.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4f65669a-e93f-4d84-9df6-e645fb771415 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104632024-11-07T22:55:48.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4f65669a-e93f-4d84-9df6-e645fb771415 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104642024-11-07T22:55:49.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2600 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4f65669a-e93f-4d84-9df6-e645fb771415 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104652024-11-07T22:55:50.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fbc55a67-33d4-4f56-8502-7a1f2ec561f7 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104662024-11-07T22:55:50.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fbc55a67-33d4-4f56-8502-7a1f2ec561f7 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104672024-11-07T22:55:50.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2716 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fbc55a67-33d4-4f56-8502-7a1f2ec561f7 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
104682024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
104692024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
104702024-11-07T22:55:50.819ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
104712024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104722024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104732024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
104742024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
104752024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
104762024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
104772024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
104782024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
104792024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104802024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104812024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
104822024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
104832024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
104842024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104852024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
104862024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
104872024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
104882024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104892024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
104902024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
104912024-11-07T22:55:50.819ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-07 22:45:50.819355882 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
104922024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
104932024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
104942024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
104952024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
104962024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
104972024-11-07T22:55:50.819ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
104982024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
104992024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
105002024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
105012024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
105022024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105032024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
105042024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
105052024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105062024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
105072024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
105082024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105092024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
105102024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
105112024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
105122024-11-07T22:55:50.819ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531
105132024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.351\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531"}
105142024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
105152024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
105162024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
105172024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
105182024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105192024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105202024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105212024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
105222024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
105232024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105242024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
105252024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
105262024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
105272024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105282024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
105292024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
105302024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
105312024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105322024-11-07T22:55:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105332024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105342024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105352024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105362024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105372024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105382024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
105392024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105402024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
105412024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105422024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
105432024-11-07T22:55:50.820ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a127151b-10b2-4835-91ce-b493ecd30481.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("de9282a1-0aa7-4ad8-a39a-58f19d05b651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1444, tv_nsec: 909146267 } })
105442024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
105452024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
105462024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105472024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105482024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105492024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105502024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
105512024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
105522024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
105532024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105542024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105552024-11-07T22:55:50.820ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19da6a5b-073a-4e12-8775-91fc61c1e962.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1444, tv_nsec: 909269951 } })
105562024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
105572024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.158851ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
105582024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
105592024-11-07T22:55:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.345807ms iteration = 15 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
105602024-11-07T22:55:50.821ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105612024-11-07T22:55:50.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105622024-11-07T22:55:50.821ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105632024-11-07T22:55:50.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105642024-11-07T22:55:50.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105652024-11-07T22:55:50.823ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.336677ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
105662024-11-07T22:55:50.823ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1444, tv_nsec: 912872958 } })
105672024-11-07T22:55:50.824ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
105682024-11-07T22:55:50.824ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
105692024-11-07T22:55:50.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105702024-11-07T22:55:50.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105712024-11-07T22:55:50.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
105722024-11-07T22:55:50.825ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105732024-11-07T22:55:50.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105742024-11-07T22:55:50.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105752024-11-07T22:55:50.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105762024-11-07T22:55:50.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105772024-11-07T22:55:50.829ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-07 22:45:50.819355882 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
105782024-11-07T22:55:50.829ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.96836ms iteration = 14 status = {"expiration":"2024-11-07T22:45:50.819355882Z","pruned":[]}
105792024-11-07T22:55:50.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105802024-11-07T22:55:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105812024-11-07T22:55:50.831ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1444, tv_nsec: 920366970 } })
105822024-11-07T22:55:50.831ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
105832024-11-07T22:55:50.840ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.286394ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
105842024-11-07T22:55:50.845ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1444, tv_nsec: 934874582 } })
105852024-11-07T22:55:50.846ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
105862024-11-07T22:55:50.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105872024-11-07T22:55:50.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105882024-11-07T22:55:50.882ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105892024-11-07T22:55:50.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105902024-11-07T22:55:50.884ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105912024-11-07T22:55:50.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105922024-11-07T22:55:50.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
105932024-11-07T22:55:50.888ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
105942024-11-07T22:55:50.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
105952024-11-07T22:55:50.889ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105962024-11-07T22:55:50.889ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
105972024-11-07T22:55:50.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105982024-11-07T22:55:50.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105992024-11-07T22:55:50.890ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.967705ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
106002024-11-07T22:55:50.890ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
106012024-11-07T22:55:50.891ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106022024-11-07T22:55:50.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106032024-11-07T22:55:50.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
106042024-11-07T22:55:50.893ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106052024-11-07T22:55:50.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106062024-11-07T22:55:50.894ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
106072024-11-07T22:55:50.894ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106082024-11-07T22:55:50.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106092024-11-07T22:55:50.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 75.201359ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
106102024-11-07T22:55:50.896ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 76.785281ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106112024-11-07T22:55:50.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106122024-11-07T22:55:50.898ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106132024-11-07T22:55:50.898ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106142024-11-07T22:55:50.898ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
106152024-11-07T22:55:50.898ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106162024-11-07T22:55:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106172024-11-07T22:55:50.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106182024-11-07T22:55:50.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106192024-11-07T22:55:50.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106202024-11-07T22:55:50.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106212024-11-07T22:55:50.900ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106222024-11-07T22:55:50.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106232024-11-07T22:55:50.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106242024-11-07T22:55:50.903ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106252024-11-07T22:55:50.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106262024-11-07T22:55:50.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106272024-11-07T22:55:50.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106282024-11-07T22:55:50.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
106292024-11-07T22:55:50.905ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106302024-11-07T22:55:50.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
106312024-11-07T22:55:50.905ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
106322024-11-07T22:55:50.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106332024-11-07T22:55:50.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106342024-11-07T22:55:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
106352024-11-07T22:55:50.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106362024-11-07T22:55:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106372024-11-07T22:55:50.907ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
106382024-11-07T22:55:50.907ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
106392024-11-07T22:55:50.907ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 88.205971ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
106402024-11-07T22:55:50.912ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106412024-11-07T22:55:50.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106422024-11-07T22:55:50.913ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106432024-11-07T22:55:50.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106442024-11-07T22:55:50.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106452024-11-07T22:55:50.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
106462024-11-07T22:55:50.916ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106472024-11-07T22:55:50.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106482024-11-07T22:55:50.917ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106492024-11-07T22:55:50.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106502024-11-07T22:55:50.919ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106512024-11-07T22:55:50.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106522024-11-07T22:55:50.923ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106532024-11-07T22:55:50.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106542024-11-07T22:55:50.930ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
106552024-11-07T22:55:50.931ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 111.427907ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
106562024-11-07T22:55:50.940ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 120.931693ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
106572024-11-07T22:55:50.949ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
106582024-11-07T22:55:50.949ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
106592024-11-07T22:55:50.949ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
106602024-11-07T22:55:50.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106612024-11-07T22:55:50.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106622024-11-07T22:55:50.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
106632024-11-07T22:55:50.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106642024-11-07T22:55:50.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
106652024-11-07T22:55:50.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
106662024-11-07T22:55:50.959ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106672024-11-07T22:55:50.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106682024-11-07T22:55:50.961ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
106692024-11-07T22:55:50.961ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
106702024-11-07T22:55:50.961ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 141.94176ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
106712024-11-07T22:55:50.962ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106722024-11-07T22:55:50.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106732024-11-07T22:55:50.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106742024-11-07T22:55:50.967ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
106752024-11-07T22:55:50.967ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
106762024-11-07T22:55:50.967ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
106772024-11-07T22:55:50.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106782024-11-07T22:55:50.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106792024-11-07T22:55:50.968ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
106802024-11-07T22:55:50.968ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106812024-11-07T22:55:50.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106822024-11-07T22:55:50.968ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106832024-11-07T22:55:50.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106842024-11-07T22:55:50.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106852024-11-07T22:55:50.973ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106862024-11-07T22:55:50.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106872024-11-07T22:55:50.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
106882024-11-07T22:55:50.975ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106892024-11-07T22:55:50.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106902024-11-07T22:55:50.978ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106912024-11-07T22:55:50.978ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
106922024-11-07T22:55:50.978ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 159.315239ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
106932024-11-07T22:55:50.984ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106942024-11-07T22:55:50.989ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
106952024-11-07T22:55:50.989ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106962024-11-07T22:55:50.989ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 169.777841ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
106972024-11-07T22:55:50.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106982024-11-07T22:55:50.998ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106992024-11-07T22:55:50.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107002024-11-07T22:55:51.002ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 182.782953ms iteration = 27 status = 0
107012024-11-07T22:55:51.002ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
107022024-11-07T22:55:51.002ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
107032024-11-07T22:55:51.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107042024-11-07T22:55:51.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107052024-11-07T22:55:51.008ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107062024-11-07T22:55:51.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107072024-11-07T22:55:51.012ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
107082024-11-07T22:55:51.012ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107092024-11-07T22:55:51.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107102024-11-07T22:55:51.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
107112024-11-07T22:55:51.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107122024-11-07T22:55:51.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107132024-11-07T22:55:51.021ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
107142024-11-07T22:55:51.021ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 202.481904ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
107152024-11-07T22:55:51.021ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
107162024-11-07T22:55:51.021ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 0 version = 2
107172024-11-07T22:55:51.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107182024-11-07T22:55:51.022ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
107192024-11-07T22:55:51.022ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
107202024-11-07T22:55:51.022ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-07 22:43:11.086261 UTC dns_group = internal generation = 1
107212024-11-07T22:55:51.022ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 203.07864ms iteration = 15 status = {"generation":1}
107222024-11-07T22:55:51.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107232024-11-07T22:55:51.025ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107242024-11-07T22:55:51.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107252024-11-07T22:55:51.030ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107262024-11-07T22:55:51.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107272024-11-07T22:55:51.032ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 1 version = 2
107282024-11-07T22:55:51.032ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
107292024-11-07T22:55:51.032ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-07 22:43:11.643428 UTC dns_group = external generation = 2
107302024-11-07T22:55:51.032ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 213.136031ms iteration = 15 status = {"generation":2}
107312024-11-07T22:55:51.034ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
107322024-11-07T22:55:51.034ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107332024-11-07T22:55:51.035ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "39cbf1d5-ae80-45bf-acc1-a855faa26d4b", "content-length": "26", "date": "Thu, 07 Nov 2024 22:55:51 GMT"} })
107342024-11-07T22:55:51.035ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107352024-11-07T22:55:51.035ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 216.06374ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
107362024-11-07T22:55:51.038ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107372024-11-07T22:55:51.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f3e8949e-070b-4609-a9ae-a05b7724198b roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
107382024-11-07T22:55:51.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f3e8949e-070b-4609-a9ae-a05b7724198b resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
107392024-11-07T22:55:51.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f3e8949e-070b-4609-a9ae-a05b7724198b response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
107402024-11-07T22:55:51.093ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-07T22:42:48.907310Z, time_modified: 2024-11-07T22:42:48.907310Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }) }
107412024-11-07T22:55:51.093ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 274.213729ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]}},"default_endpoint":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
107422024-11-07T22:55:51.107ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107432024-11-07T22:55:51.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107442024-11-07T22:55:51.108ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
107452024-11-07T22:55:51.108ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107462024-11-07T22:55:51.108ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbd9e550-7357-4bdf-9a6f-01d114b5a9db", "content-length": "26", "date": "Thu, 07 Nov 2024 22:55:51 GMT"} })
107472024-11-07T22:55:51.108ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107482024-11-07T22:55:51.109ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107492024-11-07T22:55:51.110ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107502024-11-07T22:55:51.112ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
107512024-11-07T22:55:51.112ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107522024-11-07T22:55:51.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107532024-11-07T22:55:51.114ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107542024-11-07T22:55:51.116ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 297.343734ms iteration = 31 status = {"physical_disks_added":0}
107552024-11-07T22:55:51.117ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
107562024-11-07T22:55:51.117ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107572024-11-07T22:55:51.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107582024-11-07T22:55:51.137ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
107592024-11-07T22:55:51.137ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 317.505258ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
107602024-11-07T22:55:51.210ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
107612024-11-07T22:55:51.241ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
107622024-11-07T22:55:51.241ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107632024-11-07T22:55:51.241ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f2a339a-35cb-4e1f-8ece-c3bb8bce7709", "content-length": "372", "date": "Thu, 07 Nov 2024 22:55:51 GMT"} })
107642024-11-07T22:55:51.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107652024-11-07T22:55:51.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107662024-11-07T22:55:51.242ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
107672024-11-07T22:55:51.242ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107682024-11-07T22:55:51.243ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eff80b20-a1e6-43f8-9596-775b16f01290", "content-length": "26", "date": "Thu, 07 Nov 2024 22:55:51 GMT"} })
107692024-11-07T22:55:51.243ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107702024-11-07T22:55:51.244ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
107712024-11-07T22:55:51.259ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
107722024-11-07T22:55:51.260ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 440.926228ms iteration = 27 status = {}
107732024-11-07T22:55:51.269ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
107742024-11-07T22:55:51.270ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cb14946-167f-4562-9f62-08ae37c0cea7", "content-length": "2", "date": "Thu, 07 Nov 2024 22:55:50 GMT"} })
107752024-11-07T22:55:51.272ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
107762024-11-07T22:55:51.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
107772024-11-07T22:55:51.274ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 455.169073ms iteration = 27 status = null
107782024-11-07T22:55:51.286ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
107792024-11-07T22:55:51.286ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
107802024-11-07T22:55:51.286ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a7c74597-8950-4b00-9efe-553f852f22f1", "date": "Thu, 07 Nov 2024 22:55:51 GMT"} })
107812024-11-07T22:55:51.286ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107822024-11-07T22:55:51.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107832024-11-07T22:55:51.288ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107842024-11-07T22:55:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107852024-11-07T22:55:51.335ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
107862024-11-07T22:55:51.336ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdc37d28-49f8-4bb5-abf5-22b1b300acc5", "content-length": "691", "date": "Thu, 07 Nov 2024 22:55:51 GMT"} })
107872024-11-07T22:55:51.336ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
107882024-11-07T22:55:51.336ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
107892024-11-07T22:55:51.336ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
107902024-11-07T22:55:51.338ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 519.483378ms iteration = 28 status = {}
107912024-11-07T22:55:51.339ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107922024-11-07T22:55:51.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107932024-11-07T22:55:51.343ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
107942024-11-07T22:55:51.343ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107952024-11-07T22:55:51.343ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "40026310-71d4-4a24-905a-2ed921595ac3", "date": "Thu, 07 Nov 2024 22:55:51 GMT"} })
107962024-11-07T22:55:51.344ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 525.728476ms iteration = 29 status = {}
107972024-11-07T22:55:51.459ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
107982024-11-07T22:55:51.460ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "282a4a3a-1b1d-428b-931e-3792458c1502", "date": "Thu, 07 Nov 2024 22:55:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
107992024-11-07T22:55:51.460ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108002024-11-07T22:55:51.461ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
108012024-11-07T22:55:51.462ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "763c468a-a4ef-481b-9818-6845f1d7d3bb", "date": "Thu, 07 Nov 2024 22:55:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108022024-11-07T22:55:51.462ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108032024-11-07T22:55:51.464ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108042024-11-07T22:55:51.464ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 644.995875ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
108052024-11-07T22:55:51.497ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108062024-11-07T22:55:51.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108072024-11-07T22:55:51.499ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
108082024-11-07T22:55:51.499ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2946c8a2-bf8d-46bb-9581-4e95babe4d6a", "date": "Thu, 07 Nov 2024 22:55:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108092024-11-07T22:55:51.499ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108102024-11-07T22:55:51.500ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
108112024-11-07T22:55:51.500ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108122024-11-07T22:55:51.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108132024-11-07T22:55:51.501ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "2878bcbd-f112-48b1-808c-6fcd9d2e24cb", "date": "Thu, 07 Nov 2024 22:55:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108142024-11-07T22:55:51.501ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108152024-11-07T22:55:51.502ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "abb16d19-a0fc-432c-be3d-30c730f95296", "date": "Thu, 07 Nov 2024 22:55:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108162024-11-07T22:55:51.502ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108172024-11-07T22:55:51.504ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108182024-11-07T22:55:51.504ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 684.751747ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
108192024-11-07T22:55:51.510ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
108202024-11-07T22:55:51.511ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5e9e072-a79a-44a9-a9aa-742fad345fc5", "content-length": "134", "date": "Thu, 07 Nov 2024 22:55:51 GMT"} })
108212024-11-07T22:55:51.511ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
108222024-11-07T22:55:51.511ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
108232024-11-07T22:55:51.511ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
108242024-11-07T22:55:51.511ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
108252024-11-07T22:55:51.511ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108262024-11-07T22:55:51.511ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108272024-11-07T22:55:51.511ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108282024-11-07T22:55:51.511ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
108292024-11-07T22:55:51.511ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108302024-11-07T22:55:51.511ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
108312024-11-07T22:55:51.511ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
108322024-11-07T22:55:51.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108332024-11-07T22:55:51.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108342024-11-07T22:55:51.514ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
108352024-11-07T22:55:51.514ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5183ed7-a2ad-46b9-8ce2-5f025804a9ec", "content-length": "2", "date": "Thu, 07 Nov 2024 22:55:51 GMT"} })
108362024-11-07T22:55:51.514ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
108372024-11-07T22:55:51.514ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7951093a-85e8-4077-b9e0-851ab43e9b4b", "content-length": "52", "date": "Thu, 07 Nov 2024 22:55:51 GMT"} })
108382024-11-07T22:55:51.514ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
108392024-11-07T22:55:51.514ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
108402024-11-07T22:55:51.633ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "966f4fbf-b0be-4a70-a564-3ef0eafe43be", "date": "Thu, 07 Nov 2024 22:55:51 GMT"} })
108412024-11-07T22:55:51.633ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
108422024-11-07T22:55:51.633ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
108432024-11-07T22:55:51.639ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "44132762-529f-4bec-b687-7d27437bbc94", "content-length": "682", "date": "Thu, 07 Nov 2024 22:55:51 GMT"} })
108442024-11-07T22:55:51.639ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108452024-11-07T22:55:51.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108462024-11-07T22:55:51.642ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108472024-11-07T22:55:51.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108482024-11-07T22:55:51.645ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108492024-11-07T22:55:51.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108502024-11-07T22:55:51.648ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108512024-11-07T22:55:51.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108522024-11-07T22:55:51.655ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 836.328327ms iteration = 27 status = {}
108532024-11-07T22:55:52.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b971518f-eb7d-47cd-9d80-8c085f987ba6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108542024-11-07T22:55:52.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b971518f-eb7d-47cd-9d80-8c085f987ba6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108552024-11-07T22:55:52.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b971518f-eb7d-47cd-9d80-8c085f987ba6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108562024-11-07T22:55:53.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 06b11f77-f02a-4eed-8b82-73c1e0c8a8e1 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108572024-11-07T22:55:53.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 06b11f77-f02a-4eed-8b82-73c1e0c8a8e1 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108582024-11-07T22:55:53.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1783 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 06b11f77-f02a-4eed-8b82-73c1e0c8a8e1 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108592024-11-07T22:55:54.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 16f5e3fb-5731-48ed-a5ca-24999c4c9f8f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108602024-11-07T22:55:54.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 16f5e3fb-5731-48ed-a5ca-24999c4c9f8f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108612024-11-07T22:55:54.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 16f5e3fb-5731-48ed-a5ca-24999c4c9f8f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108622024-11-07T22:55:55.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3e8f7cbe-49c8-4249-b461-072152811d5e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108632024-11-07T22:55:55.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3e8f7cbe-49c8-4249-b461-072152811d5e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108642024-11-07T22:55:55.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3e8f7cbe-49c8-4249-b461-072152811d5e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108652024-11-07T22:55:56.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 03662cdf-7b35-4a60-98f9-6df22ceb959a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108662024-11-07T22:55:56.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 03662cdf-7b35-4a60-98f9-6df22ceb959a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108672024-11-07T22:55:56.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 03662cdf-7b35-4a60-98f9-6df22ceb959a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108682024-11-07T22:55:57.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 12b043c7-b1b2-41ef-a972-bd98f1afbcfa roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108692024-11-07T22:55:57.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 12b043c7-b1b2-41ef-a972-bd98f1afbcfa resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108702024-11-07T22:55:57.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2502 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 12b043c7-b1b2-41ef-a972-bd98f1afbcfa response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108712024-11-07T22:55:58.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9f6c9f41-0831-4d05-8ba8-bc9338921e56 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108722024-11-07T22:55:58.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9f6c9f41-0831-4d05-8ba8-bc9338921e56 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108732024-11-07T22:55:58.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2423 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9f6c9f41-0831-4d05-8ba8-bc9338921e56 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108742024-11-07T22:55:59.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 52bfa320-ea4f-420f-b6a3-413c95cbf67f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108752024-11-07T22:55:59.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 52bfa320-ea4f-420f-b6a3-413c95cbf67f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108762024-11-07T22:55:59.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2023 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 52bfa320-ea4f-420f-b6a3-413c95cbf67f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108772024-11-07T22:56:00.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f95ca373-3a48-439b-aa1e-cfeff138ff10 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108782024-11-07T22:56:00.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f95ca373-3a48-439b-aa1e-cfeff138ff10 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108792024-11-07T22:56:00.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2672 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f95ca373-3a48-439b-aa1e-cfeff138ff10 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
108802024-11-07T22:56:00.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
108812024-11-07T22:56:00.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
108822024-11-07T22:56:00.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108832024-11-07T22:56:00.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108842024-11-07T22:56:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108852024-11-07T22:56:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108862024-11-07T22:56:00.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108872024-11-07T22:56:00.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108882024-11-07T22:56:00.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108892024-11-07T22:56:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108902024-11-07T22:56:00.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108912024-11-07T22:56:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108922024-11-07T22:56:00.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108932024-11-07T22:56:00.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108942024-11-07T22:56:00.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108952024-11-07T22:56:00.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
108962024-11-07T22:56:00.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108972024-11-07T22:56:00.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108982024-11-07T22:56:00.841ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
108992024-11-07T22:56:00.841ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.015462ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
109002024-11-07T22:56:00.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.649144ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109012024-11-07T22:56:01.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6c4a2d22-4acf-4757-9b85-94d264fb3024 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109022024-11-07T22:56:01.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6c4a2d22-4acf-4757-9b85-94d264fb3024 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109032024-11-07T22:56:01.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6c4a2d22-4acf-4757-9b85-94d264fb3024 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109042024-11-07T22:56:01.653ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1431 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = c93f429d-14ce-4e0b-9283-d5afc082ea2b response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
109052024-11-07T22:56:02.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 35fff688-6029-4ca3-8fc1-5f80a4ae9566 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
109062024-11-07T22:56:02.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 35fff688-6029-4ca3-8fc1-5f80a4ae9566 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
109072024-11-07T22:56:02.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 35fff688-6029-4ca3-8fc1-5f80a4ae9566 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
109082024-11-07T22:56:02.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 193fb535-6be4-41b2-8c26-02af65d53e05 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109092024-11-07T22:56:02.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 193fb535-6be4-41b2-8c26-02af65d53e05 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109102024-11-07T22:56:02.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 193fb535-6be4-41b2-8c26-02af65d53e05 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109112024-11-07T22:56:03.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0a030860-05f3-4124-bba7-e40355c9b89b roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109122024-11-07T22:56:03.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0a030860-05f3-4124-bba7-e40355c9b89b resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109132024-11-07T22:56:03.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0a030860-05f3-4124-bba7-e40355c9b89b response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109142024-11-07T22:56:04.349ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:50132
109152024-11-07T22:56:04.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50132 req_id = ac9db38e-3c8b-4f8e-bdd4-4990a6db5601 roles = RoleSet { roles: {} } uri = /metrics/producers
109162024-11-07T22:56:04.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50132 req_id = ac9db38e-3c8b-4f8e-bdd4-4990a6db5601 resource = Database result = Ok(()) uri = /metrics/producers
109172024-11-07T22:56:04.360ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = e777764e-54ab-4a09-9e71-5c47b8b59e5e
109182024-11-07T22:56:04.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10907 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50132 req_id = ac9db38e-3c8b-4f8e-bdd4-4990a6db5601 response_code = 201 uri = /metrics/producers
109192024-11-07T22:56:04.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1a812206-0ce8-44f1-b233-6e4ddba69cce roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109202024-11-07T22:56:04.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1a812206-0ce8-44f1-b233-6e4ddba69cce resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109212024-11-07T22:56:04.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1983 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1a812206-0ce8-44f1-b233-6e4ddba69cce response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109222024-11-07T22:56:05.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 737b62f2-f3af-4727-977f-b66edbd6f35f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109232024-11-07T22:56:05.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 737b62f2-f3af-4727-977f-b66edbd6f35f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109242024-11-07T22:56:05.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2350 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 737b62f2-f3af-4727-977f-b66edbd6f35f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109252024-11-07T22:56:05.781ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:42981
109262024-11-07T22:56:05.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42981 req_id = 2733c6a7-756a-468b-bafc-7cb96fedeb3c roles = RoleSet { roles: {} } uri = /metrics/producers
109272024-11-07T22:56:05.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42981 req_id = 2733c6a7-756a-468b-bafc-7cb96fedeb3c resource = Database result = Ok(()) uri = /metrics/producers
109282024-11-07T22:56:05.818ZINFOnexus: assigned collector to new producer collector_id = 1d0ef856-8367-48e8-a7e7-21f345224101 file = nexus/src/app/oximeter.rs:76 producer_id = 5fb8d961-b437-4fc7-94a2-b09d338a9d9d
109292024-11-07T22:56:05.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36706 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42981 req_id = 2733c6a7-756a-468b-bafc-7cb96fedeb3c response_code = 201 uri = /metrics/producers
109302024-11-07T22:56:06.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c6e88572-e3bf-44c9-a4e1-59777be84be2 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109312024-11-07T22:56:06.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c6e88572-e3bf-44c9-a4e1-59777be84be2 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109322024-11-07T22:56:06.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c6e88572-e3bf-44c9-a4e1-59777be84be2 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109332024-11-07T22:56:07.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7c70a7cd-40e1-4d3a-832a-d7a41825406c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109342024-11-07T22:56:07.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7c70a7cd-40e1-4d3a-832a-d7a41825406c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109352024-11-07T22:56:07.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7c70a7cd-40e1-4d3a-832a-d7a41825406c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109362024-11-07T22:56:08.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7d7c89be-47aa-4eb8-83f0-d415cf6e5178 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109372024-11-07T22:56:08.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7d7c89be-47aa-4eb8-83f0-d415cf6e5178 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109382024-11-07T22:56:08.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7d7c89be-47aa-4eb8-83f0-d415cf6e5178 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109392024-11-07T22:56:09.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 226fb8b5-e9b0-4d9c-bcc8-31bafa539db9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109402024-11-07T22:56:09.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 226fb8b5-e9b0-4d9c-bcc8-31bafa539db9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109412024-11-07T22:56:09.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 226fb8b5-e9b0-4d9c-bcc8-31bafa539db9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109422024-11-07T22:56:10.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f8e104cd-051c-4715-afaa-dcbcb5aca53e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109432024-11-07T22:56:10.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f8e104cd-051c-4715-afaa-dcbcb5aca53e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109442024-11-07T22:56:10.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2551 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f8e104cd-051c-4715-afaa-dcbcb5aca53e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109452024-11-07T22:56:10.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
109462024-11-07T22:56:10.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
109472024-11-07T22:56:10.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109482024-11-07T22:56:10.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109492024-11-07T22:56:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109502024-11-07T22:56:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109512024-11-07T22:56:10.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109522024-11-07T22:56:10.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109532024-11-07T22:56:10.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109542024-11-07T22:56:10.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.054159ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109552024-11-07T22:56:10.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109562024-11-07T22:56:10.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109572024-11-07T22:56:10.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109582024-11-07T22:56:10.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109592024-11-07T22:56:10.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109602024-11-07T22:56:10.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109612024-11-07T22:56:10.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
109622024-11-07T22:56:10.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109632024-11-07T22:56:10.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109642024-11-07T22:56:10.841ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
109652024-11-07T22:56:10.841ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.165275ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
109662024-11-07T22:56:11.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dcbc3dc9-ed3f-4d96-ab60-8dd638ba4ffb roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109672024-11-07T22:56:11.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dcbc3dc9-ed3f-4d96-ab60-8dd638ba4ffb resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109682024-11-07T22:56:11.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dcbc3dc9-ed3f-4d96-ab60-8dd638ba4ffb response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109692024-11-07T22:56:12.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 73fa2573-d919-4627-8d9a-4f5508b6a48e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109702024-11-07T22:56:12.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 73fa2573-d919-4627-8d9a-4f5508b6a48e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109712024-11-07T22:56:12.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 73fa2573-d919-4627-8d9a-4f5508b6a48e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109722024-11-07T22:56:13.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5ab4c447-f172-4357-ba08-538b0d680181 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109732024-11-07T22:56:13.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5ab4c447-f172-4357-ba08-538b0d680181 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109742024-11-07T22:56:13.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5ab4c447-f172-4357-ba08-538b0d680181 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109752024-11-07T22:56:14.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4fa5c8be-7245-42d3-b711-f7f94237b1cb roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109762024-11-07T22:56:14.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4fa5c8be-7245-42d3-b711-f7f94237b1cb resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109772024-11-07T22:56:14.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4fa5c8be-7245-42d3-b711-f7f94237b1cb response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109782024-11-07T22:56:15.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 63a62334-606b-45f0-bcde-7178d87eeb17 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109792024-11-07T22:56:15.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 63a62334-606b-45f0-bcde-7178d87eeb17 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109802024-11-07T22:56:15.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 63a62334-606b-45f0-bcde-7178d87eeb17 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109812024-11-07T22:56:16.656ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1680 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 91ccf598-c3c8-4789-854d-f76958b6697f response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
109822024-11-07T22:56:16.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 144d5118-7679-44c4-8638-d340c2684c60 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109832024-11-07T22:56:16.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 144d5118-7679-44c4-8638-d340c2684c60 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109842024-11-07T22:56:16.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 144d5118-7679-44c4-8638-d340c2684c60 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109852024-11-07T22:56:17.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 282c9b24-8fd8-4a29-a283-b89290289c52 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109862024-11-07T22:56:17.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 282c9b24-8fd8-4a29-a283-b89290289c52 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109872024-11-07T22:56:17.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 282c9b24-8fd8-4a29-a283-b89290289c52 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109882024-11-07T22:56:18.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7b9da7a3-554f-4963-8318-a0ade1c26e94 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109892024-11-07T22:56:18.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7b9da7a3-554f-4963-8318-a0ade1c26e94 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109902024-11-07T22:56:18.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2878 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7b9da7a3-554f-4963-8318-a0ade1c26e94 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109912024-11-07T22:56:19.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 50399c8f-fb8d-40fe-89ce-5802496d92cd roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109922024-11-07T22:56:19.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 50399c8f-fb8d-40fe-89ce-5802496d92cd resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109932024-11-07T22:56:19.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 50399c8f-fb8d-40fe-89ce-5802496d92cd response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109942024-11-07T22:56:20.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bccaf48b-ed5c-4e19-b1d0-c9c2faa658e4 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109952024-11-07T22:56:20.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bccaf48b-ed5c-4e19-b1d0-c9c2faa658e4 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109962024-11-07T22:56:20.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bccaf48b-ed5c-4e19-b1d0-c9c2faa658e4 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
109972024-11-07T22:56:20.818ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
109982024-11-07T22:56:20.818ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
109992024-11-07T22:56:20.818ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
110002024-11-07T22:56:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
110012024-11-07T22:56:20.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110022024-11-07T22:56:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110032024-11-07T22:56:20.818ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
110042024-11-07T22:56:20.818ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
110052024-11-07T22:56:20.818ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
110062024-11-07T22:56:20.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
110072024-11-07T22:56:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
110082024-11-07T22:56:20.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110092024-11-07T22:56:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
110102024-11-07T22:56:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
110112024-11-07T22:56:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
110122024-11-07T22:56:20.818ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
110132024-11-07T22:56:20.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110142024-11-07T22:56:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
110152024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110162024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
110172024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
110182024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110192024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
110202024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
110212024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
110222024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110232024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
110242024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110252024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
110262024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
110272024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
110282024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
110292024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
110302024-11-07T22:56:20.819ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
110312024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110322024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
110332024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110342024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110352024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110362024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
110372024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
110382024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
110392024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
110402024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
110412024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110422024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110432024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110442024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110452024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110462024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
110472024-11-07T22:56:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110482024-11-07T22:56:20.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110492024-11-07T22:56:20.822ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1474, tv_nsec: 911372408 } })
110502024-11-07T22:56:20.822ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.808113ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
110512024-11-07T22:56:20.822ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
110522024-11-07T22:56:20.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110532024-11-07T22:56:20.824ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1474, tv_nsec: 913064253 } })
110542024-11-07T22:56:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110552024-11-07T22:56:20.824ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110562024-11-07T22:56:20.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110572024-11-07T22:56:20.824ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
110582024-11-07T22:56:20.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110592024-11-07T22:56:20.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110602024-11-07T22:56:20.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110612024-11-07T22:56:20.829ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110622024-11-07T22:56:20.829ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110632024-11-07T22:56:20.831ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110642024-11-07T22:56:20.831ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
110652024-11-07T22:56:20.831ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110662024-11-07T22:56:20.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110672024-11-07T22:56:20.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110682024-11-07T22:56:20.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
110692024-11-07T22:56:20.832ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110702024-11-07T22:56:20.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110712024-11-07T22:56:20.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
110722024-11-07T22:56:20.832ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
110732024-11-07T22:56:20.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
110742024-11-07T22:56:20.834ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
110752024-11-07T22:56:20.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110762024-11-07T22:56:20.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110772024-11-07T22:56:20.836ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110782024-11-07T22:56:20.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110792024-11-07T22:56:20.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110802024-11-07T22:56:20.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110812024-11-07T22:56:20.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110822024-11-07T22:56:20.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110832024-11-07T22:56:20.840ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1474, tv_nsec: 928962662 } })
110842024-11-07T22:56:20.840ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
110852024-11-07T22:56:20.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110862024-11-07T22:56:20.843ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
110872024-11-07T22:56:20.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110882024-11-07T22:56:20.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110892024-11-07T22:56:20.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 37.337968ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
110902024-11-07T22:56:20.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110912024-11-07T22:56:20.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110922024-11-07T22:56:20.863ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110932024-11-07T22:56:20.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110942024-11-07T22:56:20.865ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
110952024-11-07T22:56:20.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
110962024-11-07T22:56:20.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.206753ms iteration = 28 status = {"errors":[],"records_set_to_done":[]}
110972024-11-07T22:56:20.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110982024-11-07T22:56:20.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110992024-11-07T22:56:20.870ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
111002024-11-07T22:56:20.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
111012024-11-07T22:56:20.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 52.908988ms iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
111022024-11-07T22:56:20.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
111032024-11-07T22:56:20.872ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111042024-11-07T22:56:20.872ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
111052024-11-07T22:56:20.872ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111062024-11-07T22:56:20.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111072024-11-07T22:56:20.873ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.267855ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111082024-11-07T22:56:20.873ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5437fef7-b139-4807-a14d-894ca360f6a2", "content-length": "26", "date": "Thu, 07 Nov 2024 22:56:20 GMT"} })
111092024-11-07T22:56:20.873ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111102024-11-07T22:56:20.873ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
111112024-11-07T22:56:20.873ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111122024-11-07T22:56:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111132024-11-07T22:56:20.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111142024-11-07T22:56:20.873ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "524d65b1-7b47-4053-9bb2-3bf105fb35a9", "content-length": "26", "date": "Thu, 07 Nov 2024 22:56:20 GMT"} })
111152024-11-07T22:56:20.873ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111162024-11-07T22:56:20.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111172024-11-07T22:56:20.875ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111182024-11-07T22:56:20.875ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
111192024-11-07T22:56:20.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111202024-11-07T22:56:20.877ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
111212024-11-07T22:56:20.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111222024-11-07T22:56:20.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
111232024-11-07T22:56:20.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111242024-11-07T22:56:20.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111252024-11-07T22:56:20.884ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111262024-11-07T22:56:20.884ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
111272024-11-07T22:56:20.884ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111282024-11-07T22:56:20.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111292024-11-07T22:56:20.885ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
111302024-11-07T22:56:20.885ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.576397ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
111312024-11-07T22:56:20.891ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
111322024-11-07T22:56:20.891ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111332024-11-07T22:56:20.891ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8de0d6e8-008c-435b-a802-fb699a44cb49", "content-length": "26", "date": "Thu, 07 Nov 2024 22:56:20 GMT"} })
111342024-11-07T22:56:20.891ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111352024-11-07T22:56:20.897ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
111362024-11-07T22:56:20.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111372024-11-07T22:56:20.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111382024-11-07T22:56:20.911ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
111392024-11-07T22:56:20.911ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.28046ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
111402024-11-07T22:56:20.915ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111412024-11-07T22:56:20.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111422024-11-07T22:56:20.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111432024-11-07T22:56:20.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
111442024-11-07T22:56:20.921ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111452024-11-07T22:56:20.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111462024-11-07T22:56:20.922ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 103.547165ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
111472024-11-07T22:56:20.922ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 103.468902ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
111482024-11-07T22:56:20.926ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111492024-11-07T22:56:20.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111502024-11-07T22:56:20.928ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111512024-11-07T22:56:20.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111522024-11-07T22:56:20.931ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111532024-11-07T22:56:20.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
111542024-11-07T22:56:20.934ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111552024-11-07T22:56:20.934ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111562024-11-07T22:56:20.934ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
111572024-11-07T22:56:20.934ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 115.544488ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
111582024-11-07T22:56:20.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111592024-11-07T22:56:20.936ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 117.062329ms iteration = 28 status = 0
111602024-11-07T22:56:20.947ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 128.523288ms iteration = 32 status = {"physical_disks_added":0}
111612024-11-07T22:56:20.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111622024-11-07T22:56:20.958ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
111632024-11-07T22:56:20.958ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111642024-11-07T22:56:20.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111652024-11-07T22:56:20.968ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
111662024-11-07T22:56:20.968ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a0883a5-2c64-4c86-a640-4705becd0b47", "content-length": "2", "date": "Thu, 07 Nov 2024 22:56:20 GMT"} })
111672024-11-07T22:56:20.970ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 151.857568ms iteration = 28 status = {}
111682024-11-07T22:56:20.971ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
111692024-11-07T22:56:20.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
111702024-11-07T22:56:20.975ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 157.029837ms iteration = 28 status = null
111712024-11-07T22:56:21.033ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
111722024-11-07T22:56:21.033ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
111732024-11-07T22:56:21.033ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ab63678-1b57-43ce-87c0-feabc76c5ff4", "content-length": "372", "date": "Thu, 07 Nov 2024 22:56:21 GMT"} })
111742024-11-07T22:56:21.033ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111752024-11-07T22:56:21.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111762024-11-07T22:56:21.051ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
111772024-11-07T22:56:21.052ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e16c270b-fa3f-40d3-b355-206ee6dc9e6e", "content-length": "691", "date": "Thu, 07 Nov 2024 22:56:21 GMT"} })
111782024-11-07T22:56:21.052ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
111792024-11-07T22:56:21.052ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
111802024-11-07T22:56:21.052ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
111812024-11-07T22:56:21.053ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 234.430317ms iteration = 29 status = {}
111822024-11-07T22:56:21.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111832024-11-07T22:56:21.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111842024-11-07T22:56:21.094ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
111852024-11-07T22:56:21.094ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
111862024-11-07T22:56:21.095ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a7153374-e99b-465c-beb7-e2158ada047e", "date": "Thu, 07 Nov 2024 22:56:21 GMT"} })
111872024-11-07T22:56:21.095ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111882024-11-07T22:56:21.095ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
111892024-11-07T22:56:21.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111902024-11-07T22:56:21.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111912024-11-07T22:56:21.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111922024-11-07T22:56:21.098ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111932024-11-07T22:56:21.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111942024-11-07T22:56:21.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111952024-11-07T22:56:21.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111962024-11-07T22:56:21.105ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
111972024-11-07T22:56:21.105ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
111982024-11-07T22:56:21.105ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e3042d5c-59f3-4321-97ff-6e35e988605a", "date": "Thu, 07 Nov 2024 22:56:21 GMT"} })
111992024-11-07T22:56:21.106ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
112002024-11-07T22:56:21.107ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 288.146175ms iteration = 30 status = {}
112012024-11-07T22:56:21.107ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa25e0c1-d256-4eec-a493-5c50eb1f9f10", "content-length": "134", "date": "Thu, 07 Nov 2024 22:56:20 GMT"} })
112022024-11-07T22:56:21.107ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
112032024-11-07T22:56:21.107ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
112042024-11-07T22:56:21.107ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
112052024-11-07T22:56:21.107ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
112062024-11-07T22:56:21.107ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112072024-11-07T22:56:21.107ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112082024-11-07T22:56:21.107ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112092024-11-07T22:56:21.107ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
112102024-11-07T22:56:21.107ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112112024-11-07T22:56:21.107ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
112122024-11-07T22:56:21.108ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
112132024-11-07T22:56:21.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112142024-11-07T22:56:21.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112152024-11-07T22:56:21.110ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
112162024-11-07T22:56:21.110ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c9a9f02-8bf2-4443-a142-3e37097d2a46", "content-length": "2", "date": "Thu, 07 Nov 2024 22:56:20 GMT"} })
112172024-11-07T22:56:21.110ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
112182024-11-07T22:56:21.110ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7cd497a-8f1f-4a30-9be2-f656f23dc36a", "content-length": "52", "date": "Thu, 07 Nov 2024 22:56:20 GMT"} })
112192024-11-07T22:56:21.110ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
112202024-11-07T22:56:21.110ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
112212024-11-07T22:56:21.235ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6d568d33-a109-4fb8-94cc-795abff4a98c", "date": "Thu, 07 Nov 2024 22:56:21 GMT"} })
112222024-11-07T22:56:21.235ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
112232024-11-07T22:56:21.235ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
112242024-11-07T22:56:21.235ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "837d7baf-e4a1-4bf3-8ba2-7734280c77d6", "content-length": "682", "date": "Thu, 07 Nov 2024 22:56:21 GMT"} })
112252024-11-07T22:56:21.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112262024-11-07T22:56:21.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112272024-11-07T22:56:21.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112282024-11-07T22:56:21.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112292024-11-07T22:56:21.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112302024-11-07T22:56:21.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112312024-11-07T22:56:21.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112322024-11-07T22:56:21.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112332024-11-07T22:56:21.253ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 435.06842ms iteration = 28 status = {}
112342024-11-07T22:56:21.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 079d1c6f-9ac1-4069-9e6c-1a3026a9081c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112352024-11-07T22:56:21.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 079d1c6f-9ac1-4069-9e6c-1a3026a9081c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112362024-11-07T22:56:21.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2640 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 079d1c6f-9ac1-4069-9e6c-1a3026a9081c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112372024-11-07T22:56:22.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c7d019f7-627a-4de6-a253-7ef52f2d9ddb roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112382024-11-07T22:56:22.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c7d019f7-627a-4de6-a253-7ef52f2d9ddb resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112392024-11-07T22:56:22.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c7d019f7-627a-4de6-a253-7ef52f2d9ddb response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112402024-11-07T22:56:23.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = df670744-a192-4e92-8041-3fe7d3bbda1f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112412024-11-07T22:56:23.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = df670744-a192-4e92-8041-3fe7d3bbda1f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112422024-11-07T22:56:23.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2339 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = df670744-a192-4e92-8041-3fe7d3bbda1f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112432024-11-07T22:56:24.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5ca51e55-8cd0-4dbb-9ee3-2a175b77c91c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112442024-11-07T22:56:24.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5ca51e55-8cd0-4dbb-9ee3-2a175b77c91c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112452024-11-07T22:56:24.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2759 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 5ca51e55-8cd0-4dbb-9ee3-2a175b77c91c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112462024-11-07T22:56:25.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c20b6d22-be34-49b5-b614-a45a91eea984 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112472024-11-07T22:56:25.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c20b6d22-be34-49b5-b614-a45a91eea984 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112482024-11-07T22:56:25.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2604 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c20b6d22-be34-49b5-b614-a45a91eea984 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112492024-11-07T22:56:26.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 65cfd0b7-aed1-4db7-929b-57150d84fdc5 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112502024-11-07T22:56:26.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 65cfd0b7-aed1-4db7-929b-57150d84fdc5 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112512024-11-07T22:56:26.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2760 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 65cfd0b7-aed1-4db7-929b-57150d84fdc5 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112522024-11-07T22:56:27.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 288c0919-f67f-44d8-92e3-0dd057963349 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112532024-11-07T22:56:27.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 288c0919-f67f-44d8-92e3-0dd057963349 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112542024-11-07T22:56:27.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2023 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 288c0919-f67f-44d8-92e3-0dd057963349 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112552024-11-07T22:56:28.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4233ffd1-36ab-484f-90e1-d34b18f41379 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112562024-11-07T22:56:28.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4233ffd1-36ab-484f-90e1-d34b18f41379 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112572024-11-07T22:56:28.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4233ffd1-36ab-484f-90e1-d34b18f41379 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112582024-11-07T22:56:29.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 000271aa-6f44-444a-812b-3798b529452e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112592024-11-07T22:56:29.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 000271aa-6f44-444a-812b-3798b529452e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112602024-11-07T22:56:29.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 000271aa-6f44-444a-812b-3798b529452e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112612024-11-07T22:56:30.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
112622024-11-07T22:56:30.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
112632024-11-07T22:56:30.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112642024-11-07T22:56:30.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112652024-11-07T22:56:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112662024-11-07T22:56:30.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112672024-11-07T22:56:30.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112682024-11-07T22:56:30.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112692024-11-07T22:56:30.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112702024-11-07T22:56:30.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112712024-11-07T22:56:30.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112722024-11-07T22:56:30.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112732024-11-07T22:56:30.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112742024-11-07T22:56:30.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112752024-11-07T22:56:30.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112762024-11-07T22:56:30.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
112772024-11-07T22:56:30.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112782024-11-07T22:56:30.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112792024-11-07T22:56:30.839ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
112802024-11-07T22:56:30.839ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.556035ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
112812024-11-07T22:56:30.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.522291ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112822024-11-07T22:56:31.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 309f97f6-7f0c-4e61-bee4-8cbdd1e12fd6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112832024-11-07T22:56:31.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 309f97f6-7f0c-4e61-bee4-8cbdd1e12fd6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112842024-11-07T22:56:31.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2071 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 309f97f6-7f0c-4e61-bee4-8cbdd1e12fd6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112852024-11-07T22:56:31.668ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1746 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 6970d82e-dde8-4d28-9dac-4c856f086749 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
112862024-11-07T22:56:32.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b168bc7b-0828-44e5-ba28-9a4db417d29b roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112872024-11-07T22:56:32.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b168bc7b-0828-44e5-ba28-9a4db417d29b resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112882024-11-07T22:56:32.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b168bc7b-0828-44e5-ba28-9a4db417d29b response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112892024-11-07T22:56:32.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = cbb99cd4-2273-47a5-a226-6b91b20405f0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
112902024-11-07T22:56:32.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = cbb99cd4-2273-47a5-a226-6b91b20405f0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
112912024-11-07T22:56:32.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = cbb99cd4-2273-47a5-a226-6b91b20405f0 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
112922024-11-07T22:56:33.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 783d1f07-c0c5-4c7a-9f66-aaa96d0f24de roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112932024-11-07T22:56:33.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 783d1f07-c0c5-4c7a-9f66-aaa96d0f24de resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112942024-11-07T22:56:33.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 783d1f07-c0c5-4c7a-9f66-aaa96d0f24de response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112952024-11-07T22:56:34.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 748aa321-5cf3-490a-b9ee-01a236f2ee01 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112962024-11-07T22:56:34.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 748aa321-5cf3-490a-b9ee-01a236f2ee01 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112972024-11-07T22:56:34.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 748aa321-5cf3-490a-b9ee-01a236f2ee01 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112982024-11-07T22:56:35.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e8b439fe-d87f-457d-bbc2-ae6e045f782c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
112992024-11-07T22:56:35.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e8b439fe-d87f-457d-bbc2-ae6e045f782c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113002024-11-07T22:56:35.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2456 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e8b439fe-d87f-457d-bbc2-ae6e045f782c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113012024-11-07T22:56:36.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2cd06c21-7c74-4eb2-aaa9-e3c7a72c2d93 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113022024-11-07T22:56:36.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2cd06c21-7c74-4eb2-aaa9-e3c7a72c2d93 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113032024-11-07T22:56:36.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2cd06c21-7c74-4eb2-aaa9-e3c7a72c2d93 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113042024-11-07T22:56:37.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bcba9299-3f1c-4bbd-8a3e-dc8578e7abb9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113052024-11-07T22:56:37.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bcba9299-3f1c-4bbd-8a3e-dc8578e7abb9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113062024-11-07T22:56:37.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2416 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = bcba9299-3f1c-4bbd-8a3e-dc8578e7abb9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113072024-11-07T22:56:38.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3b5a769e-fe10-4fc3-b553-e42c974708d8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113082024-11-07T22:56:38.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3b5a769e-fe10-4fc3-b553-e42c974708d8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113092024-11-07T22:56:38.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2583 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 3b5a769e-fe10-4fc3-b553-e42c974708d8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113102024-11-07T22:56:39.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 92d28b9f-a5c7-4339-861c-dfc799c2ef5a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113112024-11-07T22:56:39.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 92d28b9f-a5c7-4339-861c-dfc799c2ef5a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113122024-11-07T22:56:39.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 92d28b9f-a5c7-4339-861c-dfc799c2ef5a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113132024-11-07T22:56:40.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 77d801f6-d661-41b6-9420-afc210648d6e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113142024-11-07T22:56:40.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 77d801f6-d661-41b6-9420-afc210648d6e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113152024-11-07T22:56:40.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 77d801f6-d661-41b6-9420-afc210648d6e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113162024-11-07T22:56:40.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
113172024-11-07T22:56:40.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
113182024-11-07T22:56:40.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113192024-11-07T22:56:40.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113202024-11-07T22:56:40.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113212024-11-07T22:56:40.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113222024-11-07T22:56:40.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113232024-11-07T22:56:40.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113242024-11-07T22:56:40.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113252024-11-07T22:56:40.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
113262024-11-07T22:56:40.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113272024-11-07T22:56:40.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113282024-11-07T22:56:40.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113292024-11-07T22:56:40.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113302024-11-07T22:56:40.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113312024-11-07T22:56:40.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
113322024-11-07T22:56:40.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113332024-11-07T22:56:40.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113342024-11-07T22:56:40.868ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
113352024-11-07T22:56:40.868ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.67312ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
113362024-11-07T22:56:40.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.698571ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
113372024-11-07T22:56:41.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 01d8e07a-3302-486f-9371-b994b0a7811c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113382024-11-07T22:56:41.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 01d8e07a-3302-486f-9371-b994b0a7811c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113392024-11-07T22:56:41.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1797 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 01d8e07a-3302-486f-9371-b994b0a7811c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113402024-11-07T22:56:42.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 677d6af5-a79e-4255-b088-47ffecf0c3a9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113412024-11-07T22:56:42.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 677d6af5-a79e-4255-b088-47ffecf0c3a9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113422024-11-07T22:56:42.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 677d6af5-a79e-4255-b088-47ffecf0c3a9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113432024-11-07T22:56:43.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1a70c43e-3801-4895-bb7b-d0e62ee9f1af roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113442024-11-07T22:56:43.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1a70c43e-3801-4895-bb7b-d0e62ee9f1af resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113452024-11-07T22:56:43.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1a70c43e-3801-4895-bb7b-d0e62ee9f1af response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113462024-11-07T22:56:44.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c974a0aa-c8c2-4799-9bf6-ba9361311062 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113472024-11-07T22:56:44.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c974a0aa-c8c2-4799-9bf6-ba9361311062 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113482024-11-07T22:56:44.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2492 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c974a0aa-c8c2-4799-9bf6-ba9361311062 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113492024-11-07T22:56:45.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 83c9b0f9-c9e5-4826-9cc8-2ed487e46e2c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113502024-11-07T22:56:45.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 83c9b0f9-c9e5-4826-9cc8-2ed487e46e2c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113512024-11-07T22:56:45.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1823 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 83c9b0f9-c9e5-4826-9cc8-2ed487e46e2c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113522024-11-07T22:56:46.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e9c2602e-f640-47e8-bfe0-c219851cd743 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113532024-11-07T22:56:46.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e9c2602e-f640-47e8-bfe0-c219851cd743 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113542024-11-07T22:56:46.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e9c2602e-f640-47e8-bfe0-c219851cd743 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113552024-11-07T22:56:46.654ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1772 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 3c50ac52-94f3-4cd9-8f2d-3b20f8327003 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
113562024-11-07T22:56:47.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ea76ef92-b8d6-4fba-9cc4-b483200d1636 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113572024-11-07T22:56:47.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ea76ef92-b8d6-4fba-9cc4-b483200d1636 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113582024-11-07T22:56:47.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2804 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ea76ef92-b8d6-4fba-9cc4-b483200d1636 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113592024-11-07T22:56:48.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ccd79b40-722b-4c24-b7ec-150279f6ba43 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113602024-11-07T22:56:48.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ccd79b40-722b-4c24-b7ec-150279f6ba43 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113612024-11-07T22:56:48.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ccd79b40-722b-4c24-b7ec-150279f6ba43 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113622024-11-07T22:56:49.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c2f0bfd1-75af-4c14-9577-b7ad5bf3aeb2 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113632024-11-07T22:56:49.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c2f0bfd1-75af-4c14-9577-b7ad5bf3aeb2 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113642024-11-07T22:56:49.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c2f0bfd1-75af-4c14-9577-b7ad5bf3aeb2 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113652024-11-07T22:56:50.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 34700c2d-5b5d-4726-ba16-96c21a6772d6 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113662024-11-07T22:56:50.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 34700c2d-5b5d-4726-ba16-96c21a6772d6 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113672024-11-07T22:56:50.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 34700c2d-5b5d-4726-ba16-96c21a6772d6 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
113682024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
113692024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
113702024-11-07T22:56:50.819ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
113712024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
113722024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
113732024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
113742024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
113752024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
113762024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
113772024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
113782024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
113792024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
113802024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113812024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
113822024-11-07T22:56:50.819ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531
113832024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.23\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531"}
113842024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
113852024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
113862024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
113872024-11-07T22:56:50.819ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-07 22:46:50.819514304 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
113882024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
113892024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
113902024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
113912024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
113922024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113932024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
113942024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
113952024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
113962024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
113972024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113982024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
113992024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
114002024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
114012024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
114022024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
114032024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
114042024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
114052024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
114062024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
114072024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
114082024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
114092024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
114102024-11-07T22:56:50.819ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
114112024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
114122024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
114132024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114142024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
114152024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114162024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
114172024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
114182024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
114192024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
114202024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
114212024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
114222024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114232024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
114242024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114252024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
114262024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
114272024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114282024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
114292024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
114302024-11-07T22:56:50.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
114312024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
114322024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114332024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114342024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
114352024-11-07T22:56:50.820ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("19da6a5b-073a-4e12-8775-91fc61c1e962.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("939b4884-df0a-49e9-b0e5-27de78137ddd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 909215190 } })
114362024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
114372024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114382024-11-07T22:56:50.820ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a127151b-10b2-4835-91ce-b493ecd30481.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("de9282a1-0aa7-4ad8-a39a-58f19d05b651.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e7c445ee-ab31-4494-81d3-0b2af41ae707.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 909243160 } })
114392024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
114402024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
114412024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114422024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114432024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
114442024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
114452024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
114462024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
114472024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
114482024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
114492024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
114502024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114512024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
114522024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114532024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
114542024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114552024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114562024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
114572024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.156411ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
114582024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
114592024-11-07T22:56:50.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.5018ms iteration = 16 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
114602024-11-07T22:56:50.821ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114612024-11-07T22:56:50.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.066833ms iteration = 29 status = {"errors":[],"records_set_to_done":[]}
114622024-11-07T22:56:50.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114632024-11-07T22:56:50.823ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.645448ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
114642024-11-07T22:56:50.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
114652024-11-07T22:56:50.824ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
114662024-11-07T22:56:50.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
114672024-11-07T22:56:50.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
114682024-11-07T22:56:50.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114692024-11-07T22:56:50.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114702024-11-07T22:56:50.826ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114712024-11-07T22:56:50.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
114722024-11-07T22:56:50.828ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114732024-11-07T22:56:50.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114742024-11-07T22:56:50.829ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
114752024-11-07T22:56:50.829ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 918032358 } })
114762024-11-07T22:56:50.829ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114772024-11-07T22:56:50.829ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
114782024-11-07T22:56:50.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114792024-11-07T22:56:50.829ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
114802024-11-07T22:56:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
114812024-11-07T22:56:50.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
114822024-11-07T22:56:50.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
114832024-11-07T22:56:50.831ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114842024-11-07T22:56:50.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114852024-11-07T22:56:50.831ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.765508ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
114862024-11-07T22:56:50.831ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 920352120 } })
114872024-11-07T22:56:50.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114882024-11-07T22:56:50.831ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
114892024-11-07T22:56:50.833ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114902024-11-07T22:56:50.834ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114912024-11-07T22:56:50.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114922024-11-07T22:56:50.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
114932024-11-07T22:56:50.835ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
114942024-11-07T22:56:50.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
114952024-11-07T22:56:50.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
114962024-11-07T22:56:50.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
114972024-11-07T22:56:50.840ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-07 22:46:50.819514304 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
114982024-11-07T22:56:50.840ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 20.888033ms iteration = 15 status = {"expiration":"2024-11-07T22:46:50.819514304Z","pruned":[]}
114992024-11-07T22:56:50.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115002024-11-07T22:56:50.841ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115012024-11-07T22:56:50.844ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
115022024-11-07T22:56:50.844ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
115032024-11-07T22:56:50.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
115042024-11-07T22:56:50.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115052024-11-07T22:56:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115062024-11-07T22:56:50.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
115072024-11-07T22:56:50.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115082024-11-07T22:56:50.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115092024-11-07T22:56:50.847ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115102024-11-07T22:56:50.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115112024-11-07T22:56:50.848ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115122024-11-07T22:56:50.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.044153ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
115132024-11-07T22:56:50.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115142024-11-07T22:56:50.850ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
115152024-11-07T22:56:50.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115162024-11-07T22:56:50.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115172024-11-07T22:56:50.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
115182024-11-07T22:56:50.855ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
115192024-11-07T22:56:50.855ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
115202024-11-07T22:56:50.855ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
115212024-11-07T22:56:50.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
115222024-11-07T22:56:50.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115232024-11-07T22:56:50.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
115242024-11-07T22:56:50.855ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
115252024-11-07T22:56:50.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
115262024-11-07T22:56:50.857ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115272024-11-07T22:56:50.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115282024-11-07T22:56:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
115292024-11-07T22:56:50.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115302024-11-07T22:56:50.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115312024-11-07T22:56:50.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115322024-11-07T22:56:50.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
115332024-11-07T22:56:50.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115342024-11-07T22:56:50.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115352024-11-07T22:56:50.875ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.697543ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
115362024-11-07T22:56:50.876ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
115372024-11-07T22:56:50.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
115382024-11-07T22:56:50.884ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
115392024-11-07T22:56:50.884ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 64.555692ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
115402024-11-07T22:56:50.887ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
115412024-11-07T22:56:50.887ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
115422024-11-07T22:56:50.887ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 67.567093ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
115432024-11-07T22:56:50.890ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115442024-11-07T22:56:50.890ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115452024-11-07T22:56:50.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115462024-11-07T22:56:50.891ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 72.064245ms iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
115472024-11-07T22:56:50.891ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115482024-11-07T22:56:50.891ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
115492024-11-07T22:56:50.891ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
115502024-11-07T22:56:50.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115512024-11-07T22:56:50.892ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115522024-11-07T22:56:50.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
115532024-11-07T22:56:50.894ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115542024-11-07T22:56:50.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115552024-11-07T22:56:50.896ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115562024-11-07T22:56:50.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115572024-11-07T22:56:50.896ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
115582024-11-07T22:56:50.896ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
115592024-11-07T22:56:50.896ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 77.606644ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
115602024-11-07T22:56:50.897ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
115612024-11-07T22:56:50.897ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.654276ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
115622024-11-07T22:56:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
115632024-11-07T22:56:50.898ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
115642024-11-07T22:56:50.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
115652024-11-07T22:56:50.901ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 990823012 } })
115662024-11-07T22:56:50.902ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
115672024-11-07T22:56:50.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115682024-11-07T22:56:50.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115692024-11-07T22:56:50.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115702024-11-07T22:56:50.913ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115712024-11-07T22:56:50.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115722024-11-07T22:56:50.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
115732024-11-07T22:56:50.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
115742024-11-07T22:56:50.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
115752024-11-07T22:56:50.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
115762024-11-07T22:56:50.917ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
115772024-11-07T22:56:50.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
115782024-11-07T22:56:50.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
115792024-11-07T22:56:50.919ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115802024-11-07T22:56:50.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115812024-11-07T22:56:50.920ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
115822024-11-07T22:56:50.920ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
115832024-11-07T22:56:50.920ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
115842024-11-07T22:56:50.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
115852024-11-07T22:56:50.925ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 106.034642ms iteration = 29 status = 0
115862024-11-07T22:56:50.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115872024-11-07T22:56:50.935ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 116.450522ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
115882024-11-07T22:56:50.936ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 117.388928ms iteration = 33 status = {"physical_disks_added":0}
115892024-11-07T22:56:50.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
115902024-11-07T22:56:50.937ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
115912024-11-07T22:56:50.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
115922024-11-07T22:56:50.941ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 08b5e097-4d09-469f-9dcc-082c13ea546e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
115932024-11-07T22:56:50.941ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
115942024-11-07T22:56:50.941ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-07 22:43:11.086261 UTC dns_group = internal generation = 1
115952024-11-07T22:56:50.941ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 121.711574ms iteration = 16 status = {"generation":1}
115962024-11-07T22:56:50.951ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
115972024-11-07T22:56:50.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
115982024-11-07T22:56:50.955ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115992024-11-07T22:56:50.955ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
116002024-11-07T22:56:50.955ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
116012024-11-07T22:56:50.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
116022024-11-07T22:56:50.959ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
116032024-11-07T22:56:50.959ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
116042024-11-07T22:56:50.959ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
116052024-11-07T22:56:50.959ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
116062024-11-07T22:56:50.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
116072024-11-07T22:56:50.961ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116082024-11-07T22:56:50.962ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
116092024-11-07T22:56:50.962ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
116102024-11-07T22:56:50.962ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.951477ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
116112024-11-07T22:56:50.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
116122024-11-07T22:56:50.966ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
116132024-11-07T22:56:50.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
116142024-11-07T22:56:50.969ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
116152024-11-07T22:56:50.969ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 0 version = 2
116162024-11-07T22:56:50.969ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
116172024-11-07T22:56:50.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
116182024-11-07T22:56:50.972ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116192024-11-07T22:56:50.973ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 153.903582ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
116202024-11-07T22:56:50.974ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
116212024-11-07T22:56:50.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
116222024-11-07T22:56:50.977ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
116232024-11-07T22:56:50.977ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
116242024-11-07T22:56:50.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
116252024-11-07T22:56:50.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
116262024-11-07T22:56:50.980ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116272024-11-07T22:56:50.981ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
116282024-11-07T22:56:50.983ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
116292024-11-07T22:56:50.983ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
116302024-11-07T22:56:50.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
116312024-11-07T22:56:50.984ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9231cc0e-770e-430b-83a3-38a44a49a43d dns_zone_name = oxide.test found_so_far = 1 version = 2
116322024-11-07T22:56:50.984ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
116332024-11-07T22:56:50.984ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-07 22:43:11.643428 UTC dns_group = external generation = 2
116342024-11-07T22:56:50.984ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 164.668124ms iteration = 16 status = {"generation":2}
116352024-11-07T22:56:51.019ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
116362024-11-07T22:56:51.020ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
116372024-11-07T22:56:51.023ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "baa449f9-537e-4a4e-89b3-b3405e2d4c6c", "content-length": "372", "date": "Thu, 07 Nov 2024 22:56:51 GMT"} })
116382024-11-07T22:56:51.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116392024-11-07T22:56:51.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116402024-11-07T22:56:51.024ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
116412024-11-07T22:56:51.024ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
116422024-11-07T22:56:51.025ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2410e23-9326-497f-b02b-d58ede000449", "content-length": "26", "date": "Thu, 07 Nov 2024 22:56:51 GMT"} })
116432024-11-07T22:56:51.025ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
116442024-11-07T22:56:51.030ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
116452024-11-07T22:56:51.045ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
116462024-11-07T22:56:51.045ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
116472024-11-07T22:56:51.046ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "87bc4c2d-bb5d-4ba9-a485-f3b4ff1fae0c", "content-length": "26", "date": "Thu, 07 Nov 2024 22:56:51 GMT"} })
116482024-11-07T22:56:51.046ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
116492024-11-07T22:56:51.050ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
116502024-11-07T22:56:51.060ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-07T22:42:48.907310Z, time_modified: 2024-11-07T22:42:48.907310Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: a100cc61-90a7-48d2-ab79-09bcca41ca93, db_silo: Silo { identity: SiloIdentity { id: a100cc61-90a7-48d2-ab79-09bcca41ca93, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-07T22:43:11.601026Z, time_modified: 2024-11-07T22:43:11.601026Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590" }] }) }
116512024-11-07T22:56:51.061ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 241.319002ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]}},"default_endpoint":{"silo_id":"a100cc61-90a7-48d2-ab79-09bcca41ca93","tls_certs":["0e952395ad379d9cf421892577db9800c475dec77828a8c6fe1056a4a13d8590"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
116522024-11-07T22:56:51.064ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116532024-11-07T22:56:51.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116542024-11-07T22:56:51.066ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116552024-11-07T22:56:51.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
116562024-11-07T22:56:51.070ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116572024-11-07T22:56:51.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116582024-11-07T22:56:51.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116592024-11-07T22:56:51.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
116602024-11-07T22:56:51.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116612024-11-07T22:56:51.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116622024-11-07T22:56:51.099ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
116632024-11-07T22:56:51.099ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
116642024-11-07T22:56:51.099ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2c5fff42-ab34-4b51-bae5-32ce00923af9", "date": "Thu, 07 Nov 2024 22:56:51 GMT"} })
116652024-11-07T22:56:51.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116662024-11-07T22:56:51.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116672024-11-07T22:56:51.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116682024-11-07T22:56:51.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116692024-11-07T22:56:51.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116702024-11-07T22:56:51.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116712024-11-07T22:56:51.106ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
116722024-11-07T22:56:51.106ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 287.18498ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
116732024-11-07T22:56:51.108ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
116742024-11-07T22:56:51.108ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
116752024-11-07T22:56:51.109ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a206d099-743e-43b3-8bde-e9b359dc7583", "date": "Thu, 07 Nov 2024 22:56:51 GMT"} })
116762024-11-07T22:56:51.110ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 291.196418ms iteration = 31 status = {}
116772024-11-07T22:56:51.128ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
116782024-11-07T22:56:51.128ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "766f29de-1f5f-4980-a8c5-5010a1d05f0c", "date": "Thu, 07 Nov 2024 22:56:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
116792024-11-07T22:56:51.128ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
116802024-11-07T22:56:51.130ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9a1c8edb-5f48-44ff-a3ee-f4c2d9f4c3e4", "date": "Thu, 07 Nov 2024 22:56:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
116812024-11-07T22:56:51.130ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
116822024-11-07T22:56:51.133ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
116832024-11-07T22:56:51.133ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 314.169208ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
116842024-11-07T22:56:51.144ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
116852024-11-07T22:56:51.144ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
116862024-11-07T22:56:51.144ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4def2b7b-3f6e-4c54-bea1-c51aacbe20b9", "content-length": "26", "date": "Thu, 07 Nov 2024 22:56:51 GMT"} })
116872024-11-07T22:56:51.144ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
116882024-11-07T22:56:51.144ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
116892024-11-07T22:56:51.146ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
116902024-11-07T22:56:51.167ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
116912024-11-07T22:56:51.167ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d1426fe-da20-454a-8906-efddb5a61aa9", "content-length": "2", "date": "Thu, 07 Nov 2024 22:56:50 GMT"} })
116922024-11-07T22:56:51.170ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
116932024-11-07T22:56:51.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
116942024-11-07T22:56:51.173ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 353.302624ms iteration = 29 status = null
116952024-11-07T22:56:51.211ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 392.002478ms iteration = 29 status = {}
116962024-11-07T22:56:51.235ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
116972024-11-07T22:56:51.235ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f2b97c1-0f6c-4077-9c2e-5ab0acaa2a95", "content-length": "691", "date": "Thu, 07 Nov 2024 22:56:51 GMT"} })
116982024-11-07T22:56:51.235ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
116992024-11-07T22:56:51.235ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
117002024-11-07T22:56:51.235ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
117012024-11-07T22:56:51.237ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 417.885677ms iteration = 30 status = {}
117022024-11-07T22:56:51.244ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
117032024-11-07T22:56:51.245ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6246e903-1804-41ed-bd6d-e6de9fd6f2f1", "date": "Thu, 07 Nov 2024 22:56:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
117042024-11-07T22:56:51.245ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
117052024-11-07T22:56:51.247ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "395527e4-b29a-4f56-a4f3-4b0d14258ad8", "date": "Thu, 07 Nov 2024 22:56:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
117062024-11-07T22:56:51.247ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
117072024-11-07T22:56:51.248ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "db8d3e61-0eab-48e8-9116-762d29f48753", "date": "Thu, 07 Nov 2024 22:56:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
117082024-11-07T22:56:51.248ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
117092024-11-07T22:56:51.251ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
117102024-11-07T22:56:51.251ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 432.190182ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
117112024-11-07T22:56:51.319ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117122024-11-07T22:56:51.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117132024-11-07T22:56:51.321ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
117142024-11-07T22:56:51.321ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117152024-11-07T22:56:51.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117162024-11-07T22:56:51.331ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
117172024-11-07T22:56:51.331ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d79b51a4-747f-47e0-b1f1-072e9e4b72c8", "content-length": "134", "date": "Thu, 07 Nov 2024 22:56:50 GMT"} })
117182024-11-07T22:56:51.331ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
117192024-11-07T22:56:51.331ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
117202024-11-07T22:56:51.332ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
117212024-11-07T22:56:51.332ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
117222024-11-07T22:56:51.332ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
117232024-11-07T22:56:51.332ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
117242024-11-07T22:56:51.332ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
117252024-11-07T22:56:51.332ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
117262024-11-07T22:56:51.332ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
117272024-11-07T22:56:51.332ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
117282024-11-07T22:56:51.332ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
117292024-11-07T22:56:51.332ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117302024-11-07T22:56:51.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117312024-11-07T22:56:51.335ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
117322024-11-07T22:56:51.335ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "846b4c11-6b46-456b-b114-c13ff9a3e1d4", "content-length": "2", "date": "Thu, 07 Nov 2024 22:56:50 GMT"} })
117332024-11-07T22:56:51.335ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
117342024-11-07T22:56:51.335ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c11e904-2f8b-4794-8eff-fbd5a049ee8e", "content-length": "52", "date": "Thu, 07 Nov 2024 22:56:50 GMT"} })
117352024-11-07T22:56:51.335ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
117362024-11-07T22:56:51.335ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
117372024-11-07T22:56:51.475ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cfa5f3dc-a0b9-4552-83c7-568923aed431", "date": "Thu, 07 Nov 2024 22:56:51 GMT"} })
117382024-11-07T22:56:51.475ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
117392024-11-07T22:56:51.475ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
117402024-11-07T22:56:51.475ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e70537aa-d328-44dd-bdf2-4a392f8b09a2", "content-length": "682", "date": "Thu, 07 Nov 2024 22:56:51 GMT"} })
117412024-11-07T22:56:51.475ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117422024-11-07T22:56:51.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117432024-11-07T22:56:51.479ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117442024-11-07T22:56:51.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117452024-11-07T22:56:51.482ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117462024-11-07T22:56:51.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117472024-11-07T22:56:51.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117482024-11-07T22:56:51.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117492024-11-07T22:56:51.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1907b2f0-afad-45ae-9dfd-e39f7137457c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117502024-11-07T22:56:51.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1907b2f0-afad-45ae-9dfd-e39f7137457c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117512024-11-07T22:56:51.491ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 671.984253ms iteration = 29 status = {}
117522024-11-07T22:56:51.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 1907b2f0-afad-45ae-9dfd-e39f7137457c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117532024-11-07T22:56:51.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = b8d4caa3-d555-429d-9db4-f943f12a56b1 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
117542024-11-07T22:56:51.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = b8d4caa3-d555-429d-9db4-f943f12a56b1 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
117552024-11-07T22:56:51.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2620 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = b8d4caa3-d555-429d-9db4-f943f12a56b1 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
117562024-11-07T22:56:51.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = cf9fbb9e-d6b3-4d69-8d09-b9b218ac53e0 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
117572024-11-07T22:56:51.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = cf9fbb9e-d6b3-4d69-8d09-b9b218ac53e0 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
117582024-11-07T22:56:51.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2150 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = cf9fbb9e-d6b3-4d69-8d09-b9b218ac53e0 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
117592024-11-07T22:56:52.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 253277dd-a5de-44de-8092-7b8c3fc35f7a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117602024-11-07T22:56:52.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 253277dd-a5de-44de-8092-7b8c3fc35f7a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117612024-11-07T22:56:52.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 253277dd-a5de-44de-8092-7b8c3fc35f7a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117622024-11-07T22:56:53.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f2a8f0f2-4b62-41f8-9574-f5e9390b044d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117632024-11-07T22:56:53.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f2a8f0f2-4b62-41f8-9574-f5e9390b044d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117642024-11-07T22:56:53.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2004 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = f2a8f0f2-4b62-41f8-9574-f5e9390b044d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117652024-11-07T22:56:54.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b8a6e126-9d57-4ef2-8f94-f23f838167b8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117662024-11-07T22:56:54.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b8a6e126-9d57-4ef2-8f94-f23f838167b8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117672024-11-07T22:56:54.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b8a6e126-9d57-4ef2-8f94-f23f838167b8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117682024-11-07T22:56:55.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dccb0d60-fc21-4a04-a261-c6352f422d7b roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117692024-11-07T22:56:55.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dccb0d60-fc21-4a04-a261-c6352f422d7b resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117702024-11-07T22:56:55.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = dccb0d60-fc21-4a04-a261-c6352f422d7b response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117712024-11-07T22:56:56.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4375abd6-517a-4398-aacd-07b9e2c38d0e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117722024-11-07T22:56:56.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4375abd6-517a-4398-aacd-07b9e2c38d0e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117732024-11-07T22:56:56.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4375abd6-517a-4398-aacd-07b9e2c38d0e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117742024-11-07T22:56:57.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ebf054b2-d8fa-4846-bd30-4277b0da360a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117752024-11-07T22:56:57.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ebf054b2-d8fa-4846-bd30-4277b0da360a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117762024-11-07T22:56:57.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ebf054b2-d8fa-4846-bd30-4277b0da360a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117772024-11-07T22:56:58.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ded1d503-8ca9-48cb-af29-bc50255c9b45 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117782024-11-07T22:56:58.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ded1d503-8ca9-48cb-af29-bc50255c9b45 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117792024-11-07T22:56:58.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ded1d503-8ca9-48cb-af29-bc50255c9b45 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117802024-11-07T22:56:59.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 683549db-ddf0-48f4-92dd-7804fdd0de6e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117812024-11-07T22:56:59.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 683549db-ddf0-48f4-92dd-7804fdd0de6e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117822024-11-07T22:56:59.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2602 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 683549db-ddf0-48f4-92dd-7804fdd0de6e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117832024-11-07T22:57:00.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 56014cf2-1b5d-48d3-9958-c4b15c04bd06 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117842024-11-07T22:57:00.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 56014cf2-1b5d-48d3-9958-c4b15c04bd06 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117852024-11-07T22:57:00.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 56014cf2-1b5d-48d3-9958-c4b15c04bd06 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
117862024-11-07T22:57:00.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
117872024-11-07T22:57:00.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
117882024-11-07T22:57:00.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117892024-11-07T22:57:00.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117902024-11-07T22:57:00.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117912024-11-07T22:57:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117922024-11-07T22:57:00.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117932024-11-07T22:57:00.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117942024-11-07T22:57:00.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117952024-11-07T22:57:00.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.493294ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117962024-11-07T22:57:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117972024-11-07T22:57:00.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117982024-11-07T22:57:00.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117992024-11-07T22:57:00.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118002024-11-07T22:57:00.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118012024-11-07T22:57:00.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118022024-11-07T22:57:00.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
118032024-11-07T22:57:00.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118042024-11-07T22:57:00.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118052024-11-07T22:57:00.839ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
118062024-11-07T22:57:00.839ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.610396ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
118072024-11-07T22:57:01.654ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2430 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = fc99bd0d-685a-4a0d-960a-ca3afc039ac1 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
118082024-11-07T22:57:01.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 47ee2621-28ff-4b12-bb2d-8b792c9f913e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118092024-11-07T22:57:01.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 47ee2621-28ff-4b12-bb2d-8b792c9f913e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118102024-11-07T22:57:01.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 47ee2621-28ff-4b12-bb2d-8b792c9f913e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118112024-11-07T22:57:02.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 5d0414d0-90f3-4901-9f1e-d36f6163d898 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
118122024-11-07T22:57:02.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 5d0414d0-90f3-4901-9f1e-d36f6163d898 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
118132024-11-07T22:57:02.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2891 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 5d0414d0-90f3-4901-9f1e-d36f6163d898 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
118142024-11-07T22:57:02.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7ab2b9b1-f8ab-4768-9e68-8703dd339d83 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118152024-11-07T22:57:02.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7ab2b9b1-f8ab-4768-9e68-8703dd339d83 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118162024-11-07T22:57:02.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7ab2b9b1-f8ab-4768-9e68-8703dd339d83 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118172024-11-07T22:57:03.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ec06150e-04a6-4300-bba2-093397edf504 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118182024-11-07T22:57:03.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ec06150e-04a6-4300-bba2-093397edf504 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118192024-11-07T22:57:03.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ec06150e-04a6-4300-bba2-093397edf504 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118202024-11-07T22:57:04.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b68546a4-5fd5-47c8-a023-461e485e16b5 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118212024-11-07T22:57:04.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b68546a4-5fd5-47c8-a023-461e485e16b5 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118222024-11-07T22:57:04.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b68546a4-5fd5-47c8-a023-461e485e16b5 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118232024-11-07T22:57:05.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ac5b0c0d-884e-41f5-afce-db2461231464 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118242024-11-07T22:57:05.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ac5b0c0d-884e-41f5-afce-db2461231464 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118252024-11-07T22:57:05.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2743 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = ac5b0c0d-884e-41f5-afce-db2461231464 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118262024-11-07T22:57:06.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 77eca191-199c-42d9-94e5-078ca8236a50 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
118272024-11-07T22:57:06.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 77eca191-199c-42d9-94e5-078ca8236a50 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
118282024-11-07T22:57:06.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 77eca191-199c-42d9-94e5-078ca8236a50 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
118292024-11-07T22:57:06.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = cfb30b99-d6c3-4f44-a810-19f3b2fecc34 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
118302024-11-07T22:57:06.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = cfb30b99-d6c3-4f44-a810-19f3b2fecc34 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
118312024-11-07T22:57:06.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = cfb30b99-d6c3-4f44-a810-19f3b2fecc34 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
118322024-11-07T22:57:06.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7d02ca4d-0aef-4d72-859d-7c291459b981 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118332024-11-07T22:57:06.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7d02ca4d-0aef-4d72-859d-7c291459b981 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118342024-11-07T22:57:06.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7d02ca4d-0aef-4d72-859d-7c291459b981 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118352024-11-07T22:57:07.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 711c8e93-e963-40d5-a1a7-5cb40e576f64 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118362024-11-07T22:57:07.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 711c8e93-e963-40d5-a1a7-5cb40e576f64 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118372024-11-07T22:57:07.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 711c8e93-e963-40d5-a1a7-5cb40e576f64 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118382024-11-07T22:57:08.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c78388f2-a0be-420f-877a-69f3283af64f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118392024-11-07T22:57:08.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c78388f2-a0be-420f-877a-69f3283af64f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118402024-11-07T22:57:08.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c78388f2-a0be-420f-877a-69f3283af64f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118412024-11-07T22:57:09.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 584852b8-ee42-4e2d-abdf-6d13fe40a569 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118422024-11-07T22:57:09.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 584852b8-ee42-4e2d-abdf-6d13fe40a569 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118432024-11-07T22:57:09.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1836 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 584852b8-ee42-4e2d-abdf-6d13fe40a569 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118442024-11-07T22:57:10.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
118452024-11-07T22:57:10.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
118462024-11-07T22:57:10.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118472024-11-07T22:57:10.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118482024-11-07T22:57:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118492024-11-07T22:57:10.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118502024-11-07T22:57:10.821ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118512024-11-07T22:57:10.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118522024-11-07T22:57:10.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.80892ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
118532024-11-07T22:57:10.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118542024-11-07T22:57:10.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
118552024-11-07T22:57:10.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118562024-11-07T22:57:10.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118572024-11-07T22:57:10.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118582024-11-07T22:57:10.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118592024-11-07T22:57:10.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118602024-11-07T22:57:10.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
118612024-11-07T22:57:10.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118622024-11-07T22:57:10.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118632024-11-07T22:57:10.874ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
118642024-11-07T22:57:10.874ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.687133ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
118652024-11-07T22:57:10.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e4c259da-9bfe-4f81-97e6-ab0a8adab4de roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118662024-11-07T22:57:10.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e4c259da-9bfe-4f81-97e6-ab0a8adab4de resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118672024-11-07T22:57:10.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2557 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e4c259da-9bfe-4f81-97e6-ab0a8adab4de response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118682024-11-07T22:57:11.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0f8364b5-f223-47ae-8878-e2d8b5e5bf12 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118692024-11-07T22:57:11.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0f8364b5-f223-47ae-8878-e2d8b5e5bf12 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118702024-11-07T22:57:11.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0f8364b5-f223-47ae-8878-e2d8b5e5bf12 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118712024-11-07T22:57:13.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b2405841-aacb-4189-b484-845a930b160c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118722024-11-07T22:57:13.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b2405841-aacb-4189-b484-845a930b160c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118732024-11-07T22:57:13.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2393 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b2405841-aacb-4189-b484-845a930b160c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118742024-11-07T22:57:14.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8e484248-30a3-407b-9e8a-71962540ac89 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118752024-11-07T22:57:14.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8e484248-30a3-407b-9e8a-71962540ac89 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118762024-11-07T22:57:14.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8e484248-30a3-407b-9e8a-71962540ac89 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118772024-11-07T22:57:15.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0fc4ca00-fcd7-47df-8a1f-41cf390da602 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118782024-11-07T22:57:15.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0fc4ca00-fcd7-47df-8a1f-41cf390da602 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118792024-11-07T22:57:15.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0fc4ca00-fcd7-47df-8a1f-41cf390da602 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118802024-11-07T22:57:16.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d0e8f713-618d-4a19-b0ce-132e1c3e61f4 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118812024-11-07T22:57:16.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d0e8f713-618d-4a19-b0ce-132e1c3e61f4 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118822024-11-07T22:57:16.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = d0e8f713-618d-4a19-b0ce-132e1c3e61f4 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118832024-11-07T22:57:16.655ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1361 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = ce7ee0d0-0728-4f4c-b611-f7296fb1edd7 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
118842024-11-07T22:57:17.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 09a44bcd-4046-4bca-b195-950196ec1177 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118852024-11-07T22:57:17.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 09a44bcd-4046-4bca-b195-950196ec1177 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118862024-11-07T22:57:17.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 09a44bcd-4046-4bca-b195-950196ec1177 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118872024-11-07T22:57:18.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 22985c13-b2ef-4190-ae0f-9a0ba6e3977e roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118882024-11-07T22:57:18.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 22985c13-b2ef-4190-ae0f-9a0ba6e3977e resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118892024-11-07T22:57:18.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2781 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 22985c13-b2ef-4190-ae0f-9a0ba6e3977e response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118902024-11-07T22:57:19.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 15ec7f00-a850-468f-b383-201cbac13c74 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118912024-11-07T22:57:19.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 15ec7f00-a850-468f-b383-201cbac13c74 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118922024-11-07T22:57:19.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 15ec7f00-a850-468f-b383-201cbac13c74 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118932024-11-07T22:57:20.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fe24f115-3bb0-4493-8b23-a8b69e78f296 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118942024-11-07T22:57:20.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fe24f115-3bb0-4493-8b23-a8b69e78f296 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118952024-11-07T22:57:20.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2647 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = fe24f115-3bb0-4493-8b23-a8b69e78f296 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
118962024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
118972024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
118982024-11-07T22:57:20.818ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
118992024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119002024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
119012024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119022024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
119032024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
119042024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
119052024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
119062024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
119072024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119082024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119092024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
119102024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119112024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
119122024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
119132024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
119142024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
119152024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
119162024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
119172024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
119182024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
119192024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
119202024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
119212024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
119222024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119232024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
119242024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
119252024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
119262024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
119272024-11-07T22:57:20.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
119282024-11-07T22:57:20.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119292024-11-07T22:57:20.819ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
119302024-11-07T22:57:20.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
119312024-11-07T22:57:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119322024-11-07T22:57:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
119332024-11-07T22:57:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
119342024-11-07T22:57:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
119352024-11-07T22:57:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119362024-11-07T22:57:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119372024-11-07T22:57:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119382024-11-07T22:57:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
119392024-11-07T22:57:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
119402024-11-07T22:57:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
119412024-11-07T22:57:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
119422024-11-07T22:57:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119432024-11-07T22:57:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119442024-11-07T22:57:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
119452024-11-07T22:57:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119462024-11-07T22:57:20.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
119472024-11-07T22:57:20.820ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119482024-11-07T22:57:20.822ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1534, tv_nsec: 911035669 } })
119492024-11-07T22:57:20.822ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
119502024-11-07T22:57:20.822ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.06673ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
119512024-11-07T22:57:20.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
119522024-11-07T22:57:20.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119532024-11-07T22:57:20.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119542024-11-07T22:57:20.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119552024-11-07T22:57:20.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119562024-11-07T22:57:20.826ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1534, tv_nsec: 915101858 } })
119572024-11-07T22:57:20.826ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
119582024-11-07T22:57:20.826ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
119592024-11-07T22:57:20.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119602024-11-07T22:57:20.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119612024-11-07T22:57:20.827ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
119622024-11-07T22:57:20.827ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
119632024-11-07T22:57:20.827ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
119642024-11-07T22:57:20.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
119652024-11-07T22:57:20.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
119662024-11-07T22:57:20.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119672024-11-07T22:57:20.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119682024-11-07T22:57:20.828ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.482426ms iteration = 30 status = {"errors":[],"records_set_to_done":[]}
119692024-11-07T22:57:20.830ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119702024-11-07T22:57:20.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119712024-11-07T22:57:20.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119722024-11-07T22:57:20.832ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c1e85b8f-73ff-449f-b9a8-ac0480ffdec1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1534, tv_nsec: 921514991 } })
119732024-11-07T22:57:20.832ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
119742024-11-07T22:57:20.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
119752024-11-07T22:57:20.834ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
119762024-11-07T22:57:20.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
119772024-11-07T22:57:20.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119782024-11-07T22:57:20.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
119792024-11-07T22:57:20.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119802024-11-07T22:57:20.834ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
119812024-11-07T22:57:20.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119822024-11-07T22:57:20.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119832024-11-07T22:57:20.836ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119842024-11-07T22:57:20.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119852024-11-07T22:57:20.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119862024-11-07T22:57:20.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119872024-11-07T22:57:20.838ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119882024-11-07T22:57:20.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119892024-11-07T22:57:20.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119902024-11-07T22:57:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
119912024-11-07T22:57:20.844ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119922024-11-07T22:57:20.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119932024-11-07T22:57:20.846ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
119942024-11-07T22:57:20.846ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 27.078911ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
119952024-11-07T22:57:20.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
119962024-11-07T22:57:20.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
119972024-11-07T22:57:20.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 40.575325ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
119982024-11-07T22:57:20.860ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119992024-11-07T22:57:20.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120002024-11-07T22:57:20.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120012024-11-07T22:57:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
120022024-11-07T22:57:20.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120032024-11-07T22:57:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120042024-11-07T22:57:20.869ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
120052024-11-07T22:57:20.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
120062024-11-07T22:57:20.875ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
120072024-11-07T22:57:20.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
120082024-11-07T22:57:20.881ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
120092024-11-07T22:57:20.881ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
120102024-11-07T22:57:20.881ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
120112024-11-07T22:57:20.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
120122024-11-07T22:57:20.937ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
120132024-11-07T22:57:20.937ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
120142024-11-07T22:57:20.937ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0479a51-2b09-4394-aa2c-a8d79fb1f883", "content-length": "26", "date": "Thu, 07 Nov 2024 22:57:20 GMT"} })
120152024-11-07T22:57:20.937ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
120162024-11-07T22:57:20.940ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
120172024-11-07T22:57:20.978ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f zone_address = fd00:1122:3344:101::2
120182024-11-07T22:57:20.978ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
120192024-11-07T22:57:20.979ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0dc34dd3-63b0-4527-b698-17b657ae2fed", "content-length": "26", "date": "Thu, 07 Nov 2024 22:57:20 GMT"} })
120202024-11-07T22:57:20.979ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
120212024-11-07T22:57:20.981ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
120222024-11-07T22:57:21.022ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
120232024-11-07T22:57:21.022ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
120242024-11-07T22:57:21.023ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8686357-2484-4b59-a892-cf30ce9a156e", "content-length": "372", "date": "Thu, 07 Nov 2024 22:57:21 GMT"} })
120252024-11-07T22:57:21.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120262024-11-07T22:57:21.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120272024-11-07T22:57:21.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120282024-11-07T22:57:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
120292024-11-07T22:57:21.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120302024-11-07T22:57:21.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120312024-11-07T22:57:21.031ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120322024-11-07T22:57:21.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120332024-11-07T22:57:21.032ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 214.020015ms iteration = 30 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
120342024-11-07T22:57:21.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120352024-11-07T22:57:21.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120362024-11-07T22:57:21.035ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120372024-11-07T22:57:21.038ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
120382024-11-07T22:57:21.038ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120392024-11-07T22:57:21.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120402024-11-07T22:57:21.039ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
120412024-11-07T22:57:21.039ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
120422024-11-07T22:57:21.040ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9b159c5-0917-4377-8513-df7597277049", "content-length": "26", "date": "Thu, 07 Nov 2024 22:57:20 GMT"} })
120432024-11-07T22:57:21.040ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
120442024-11-07T22:57:21.042ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
120452024-11-07T22:57:21.045ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
120462024-11-07T22:57:21.046ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 227.024686ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
120472024-11-07T22:57:21.060ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 241.175388ms iteration = 30 status = {}
120482024-11-07T22:57:21.062ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
120492024-11-07T22:57:21.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
120502024-11-07T22:57:21.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120512024-11-07T22:57:21.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120522024-11-07T22:57:21.071ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120532024-11-07T22:57:21.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120542024-11-07T22:57:21.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 254.23946ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
120552024-11-07T22:57:21.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 256.711718ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
120562024-11-07T22:57:21.080ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120572024-11-07T22:57:21.080ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
120582024-11-07T22:57:21.080ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
120592024-11-07T22:57:21.080ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 261.64517ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
120602024-11-07T22:57:21.082ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
120612024-11-07T22:57:21.082ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120622024-11-07T22:57:21.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120632024-11-07T22:57:21.084ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
120642024-11-07T22:57:21.084ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
120652024-11-07T22:57:21.085ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ebce3adc-7db4-4356-92bf-69131d2c27ce", "date": "Thu, 07 Nov 2024 22:57:21 GMT"} })
120662024-11-07T22:57:21.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120672024-11-07T22:57:21.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120682024-11-07T22:57:21.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120692024-11-07T22:57:21.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120702024-11-07T22:57:21.089ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120712024-11-07T22:57:21.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120722024-11-07T22:57:21.092ZINFOnexus (BackgroundTasks): VPC route manager sled c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
120732024-11-07T22:57:21.092ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
120742024-11-07T22:57:21.093ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8bce942e-7df8-442e-9cd3-e358457236ab", "date": "Thu, 07 Nov 2024 22:57:21 GMT"} })
120752024-11-07T22:57:21.093ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 275.271658ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
120762024-11-07T22:57:21.094ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 276.257505ms iteration = 32 status = {}
120772024-11-07T22:57:21.108ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120782024-11-07T22:57:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c1e85b8f-73ff-449f-b9a8-ac0480ffdec1, lookup_type: ById(c1e85b8f-73ff-449f-b9a8-ac0480ffdec1) } result = Ok(())
120792024-11-07T22:57:21.111ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120802024-11-07T22:57:21.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120812024-11-07T22:57:21.132ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
120822024-11-07T22:57:21.133ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "da188060-1f9b-4ec4-8dd1-abfb9a2cf573", "content-length": "2", "date": "Thu, 07 Nov 2024 22:57:21 GMT"} })
120832024-11-07T22:57:21.136ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
120842024-11-07T22:57:21.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
120852024-11-07T22:57:21.144ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 325.637967ms iteration = 34 status = {"physical_disks_added":0}
120862024-11-07T22:57:21.165ZDEBGnexus (BackgroundTasks): client request SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
120872024-11-07T22:57:21.165ZDEBGnexus (BackgroundTasks): client response SledAgent = c1e85b8f-73ff-449f-b9a8-ac0480ffdec1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2791135c-6996-4c62-8efa-0ced43c0b649", "content-length": "691", "date": "Thu, 07 Nov 2024 22:57:21 GMT"} })
120882024-11-07T22:57:21.165ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
120892024-11-07T22:57:21.165ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
120902024-11-07T22:57:21.165ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
120912024-11-07T22:57:21.166ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 347.921718ms iteration = 30 status = 0
120922024-11-07T22:57:21.166ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 347.958669ms iteration = 31 status = {}
120932024-11-07T22:57:21.167ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 348.912425ms iteration = 30 status = null
120942024-11-07T22:57:21.195ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120952024-11-07T22:57:21.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120962024-11-07T22:57:21.198ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: d61d9b86-50da-4a9b-a561-5f5f72ac90ea, rack_id: 1a2f25b5-769a-4c68-be75-53fcae3bde7f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e9857e6a-c4b2-43a6-a46c-321045ff6e97) } rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
120972024-11-07T22:57:21.198ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120982024-11-07T22:57:21.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120992024-11-07T22:57:21.207ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
121002024-11-07T22:57:21.208ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "50ad4795-c93c-4b97-8136-f1a9c0e0368c", "content-length": "134", "date": "Thu, 07 Nov 2024 22:57:21 GMT"} })
121012024-11-07T22:57:21.208ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
121022024-11-07T22:57:21.208ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e9857e6a-c4b2-43a6-a46c-321045ff6e97
121032024-11-07T22:57:21.208ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
121042024-11-07T22:57:21.208ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
121052024-11-07T22:57:21.208ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121062024-11-07T22:57:21.208ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121072024-11-07T22:57:21.208ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121082024-11-07T22:57:21.208ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
121092024-11-07T22:57:21.208ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121102024-11-07T22:57:21.208ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
121112024-11-07T22:57:21.208ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f
121122024-11-07T22:57:21.208ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121132024-11-07T22:57:21.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121142024-11-07T22:57:21.211ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
121152024-11-07T22:57:21.211ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d809f9a7-0c5c-4ae2-bb46-6ade4a00d9b3", "content-length": "2", "date": "Thu, 07 Nov 2024 22:57:21 GMT"} })
121162024-11-07T22:57:21.211ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
121172024-11-07T22:57:21.211ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fab66cf5-6326-4e87-8d5d-a75ae1ec8155", "content-length": "52", "date": "Thu, 07 Nov 2024 22:57:21 GMT"} })
121182024-11-07T22:57:21.211ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch_location = Switch0
121192024-11-07T22:57:21.211ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
121202024-11-07T22:57:21.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b8515177-2cfa-467a-ae61-3a68ccc4a3e9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121212024-11-07T22:57:21.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b8515177-2cfa-467a-ae61-3a68ccc4a3e9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121222024-11-07T22:57:21.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2849 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = b8515177-2cfa-467a-ae61-3a68ccc4a3e9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121232024-11-07T22:57:21.406ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c1891f76-b129-4c6f-ad3a-b39573876ee4", "date": "Thu, 07 Nov 2024 22:57:21 GMT"} })
121242024-11-07T22:57:21.406ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f switch = Switch0
121252024-11-07T22:57:21.406ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
121262024-11-07T22:57:21.411ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1a2f25b5-769a-4c68-be75-53fcae3bde7f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d50232c5-5395-4c67-ae00-63863e6bb6ab", "content-length": "682", "date": "Thu, 07 Nov 2024 22:57:21 GMT"} })
121272024-11-07T22:57:21.411ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121282024-11-07T22:57:21.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121292024-11-07T22:57:21.415ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121302024-11-07T22:57:21.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121312024-11-07T22:57:21.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121322024-11-07T22:57:21.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121332024-11-07T22:57:21.421ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121342024-11-07T22:57:21.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121352024-11-07T22:57:21.429ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 610.473013ms iteration = 30 status = {}
121362024-11-07T22:57:22.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2b9a6301-2602-4e20-914d-b9ac22c63738 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121372024-11-07T22:57:22.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2b9a6301-2602-4e20-914d-b9ac22c63738 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121382024-11-07T22:57:22.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 2b9a6301-2602-4e20-914d-b9ac22c63738 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121392024-11-07T22:57:23.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 62eab701-c8c6-4596-9270-cd6e3f6dcfc4 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121402024-11-07T22:57:23.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 62eab701-c8c6-4596-9270-cd6e3f6dcfc4 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121412024-11-07T22:57:23.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 62eab701-c8c6-4596-9270-cd6e3f6dcfc4 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121422024-11-07T22:57:24.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 03f9faa1-d31b-4efc-8ac8-43a3147cb6cd roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121432024-11-07T22:57:24.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 03f9faa1-d31b-4efc-8ac8-43a3147cb6cd resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121442024-11-07T22:57:24.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 03f9faa1-d31b-4efc-8ac8-43a3147cb6cd response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121452024-11-07T22:57:25.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e3ca867a-638f-4a0a-90f6-4d617462846c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121462024-11-07T22:57:25.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e3ca867a-638f-4a0a-90f6-4d617462846c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121472024-11-07T22:57:25.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2734 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = e3ca867a-638f-4a0a-90f6-4d617462846c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121482024-11-07T22:57:26.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7a62a8c1-eb23-4558-aea2-48804ba58e2f roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121492024-11-07T22:57:26.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7a62a8c1-eb23-4558-aea2-48804ba58e2f resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121502024-11-07T22:57:26.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 7a62a8c1-eb23-4558-aea2-48804ba58e2f response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121512024-11-07T22:57:27.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0f628db6-a19f-47c7-bbe5-02db8a0b45ac roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121522024-11-07T22:57:27.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0f628db6-a19f-47c7-bbe5-02db8a0b45ac resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121532024-11-07T22:57:27.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2430 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 0f628db6-a19f-47c7-bbe5-02db8a0b45ac response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121542024-11-07T22:57:28.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 009fbfde-7fa2-470a-b872-ee41bac1900d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121552024-11-07T22:57:28.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 009fbfde-7fa2-470a-b872-ee41bac1900d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121562024-11-07T22:57:28.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 009fbfde-7fa2-470a-b872-ee41bac1900d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121572024-11-07T22:57:29.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 69054a2b-2ec1-4198-a89c-1b3e9fdd5a4d roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121582024-11-07T22:57:29.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 69054a2b-2ec1-4198-a89c-1b3e9fdd5a4d resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121592024-11-07T22:57:29.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 69054a2b-2ec1-4198-a89c-1b3e9fdd5a4d response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121602024-11-07T22:57:30.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8177b0ee-a9a6-4387-a5e7-47e252bbcceb roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121612024-11-07T22:57:30.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8177b0ee-a9a6-4387-a5e7-47e252bbcceb resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121622024-11-07T22:57:30.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 8177b0ee-a9a6-4387-a5e7-47e252bbcceb response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121632024-11-07T22:57:30.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
121642024-11-07T22:57:30.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
121652024-11-07T22:57:30.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121662024-11-07T22:57:30.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121672024-11-07T22:57:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121682024-11-07T22:57:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121692024-11-07T22:57:30.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121702024-11-07T22:57:30.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
121712024-11-07T22:57:30.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121722024-11-07T22:57:30.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121732024-11-07T22:57:30.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121742024-11-07T22:57:30.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121752024-11-07T22:57:30.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121762024-11-07T22:57:30.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121772024-11-07T22:57:30.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121782024-11-07T22:57:30.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
121792024-11-07T22:57:30.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121802024-11-07T22:57:30.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121812024-11-07T22:57:30.868ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
121822024-11-07T22:57:30.868ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.03157ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
121832024-11-07T22:57:30.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.80394ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
121842024-11-07T22:57:31.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c8df13be-db16-4c7d-89c4-d7230b6d39a5 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121852024-11-07T22:57:31.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c8df13be-db16-4c7d-89c4-d7230b6d39a5 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121862024-11-07T22:57:31.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2067 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = c8df13be-db16-4c7d-89c4-d7230b6d39a5 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121872024-11-07T22:57:31.654ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1518 local_addr = [fd00:1122:3344:101::b]:56372 method = GET remote_addr = [fd00:1122:3344:101::d]:32984 req_id = 0624396a-1ae7-43de-aeb2-0dbef075d356 response_code = 200 uri = /377e4941-a34d-4c51-b725-3cc833f8df14
121882024-11-07T22:57:32.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 7d35c8c3-988e-463d-8499-cfbf0d19a26f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
121892024-11-07T22:57:32.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 7d35c8c3-988e-463d-8499-cfbf0d19a26f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
121902024-11-07T22:57:32.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3892 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:37503 req_id = 7d35c8c3-988e-463d-8499-cfbf0d19a26f response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
121912024-11-07T22:57:32.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 14bd9d98-3fa8-4b06-8baa-e54a949db53b roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121922024-11-07T22:57:32.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 14bd9d98-3fa8-4b06-8baa-e54a949db53b resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121932024-11-07T22:57:32.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2071 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 14bd9d98-3fa8-4b06-8baa-e54a949db53b response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121942024-11-07T22:57:33.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 775cdaf8-14f6-4fcb-8da0-228c61c576b1 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121952024-11-07T22:57:33.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 775cdaf8-14f6-4fcb-8da0-228c61c576b1 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121962024-11-07T22:57:33.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 775cdaf8-14f6-4fcb-8da0-228c61c576b1 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121972024-11-07T22:57:34.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4cdc1f06-e954-4ca0-9dc5-5cd46ea2abf3 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121982024-11-07T22:57:34.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4cdc1f06-e954-4ca0-9dc5-5cd46ea2abf3 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
121992024-11-07T22:57:34.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2339 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 4cdc1f06-e954-4ca0-9dc5-5cd46ea2abf3 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122002024-11-07T22:57:35.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 512c281c-4285-4f78-a32b-4bfb78cf0629 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122012024-11-07T22:57:35.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 512c281c-4285-4f78-a32b-4bfb78cf0629 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122022024-11-07T22:57:35.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 512c281c-4285-4f78-a32b-4bfb78cf0629 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122032024-11-07T22:57:36.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 378bed49-9f27-4f02-bd84-4e8ad717c326 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
122042024-11-07T22:57:36.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 378bed49-9f27-4f02-bd84-4e8ad717c326 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
122052024-11-07T22:57:36.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 378bed49-9f27-4f02-bd84-4e8ad717c326 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?sort_by=id_ascending
122062024-11-07T22:57:36.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 315c4b37-9aaf-4a37-81a1-15d62b9c8905 roles = RoleSet { roles: {} } uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
122072024-11-07T22:57:36.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 315c4b37-9aaf-4a37-81a1-15d62b9c8905 resource = Database result = Ok(()) uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
122082024-11-07T22:57:36.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46454 req_id = 315c4b37-9aaf-4a37-81a1-15d62b9c8905 response_code = 200 uri = /metrics/collectors/1d0ef856-8367-48e8-a7e7-21f345224101/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzc3NzY0ZS01NGFiLTRhMDktOWU3MS01YzQ3YjhiNTllNWUifX0%3D
122092024-11-07T22:57:36.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9b9c766b-52b6-4ebf-83f6-e5898a50a508 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122102024-11-07T22:57:36.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9b9c766b-52b6-4ebf-83f6-e5898a50a508 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122112024-11-07T22:57:36.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9b9c766b-52b6-4ebf-83f6-e5898a50a508 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122122024-11-07T22:57:37.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 37ffba71-a63f-4050-8b16-bbcf7b67aab9 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122132024-11-07T22:57:37.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 37ffba71-a63f-4050-8b16-bbcf7b67aab9 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122142024-11-07T22:57:37.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 37ffba71-a63f-4050-8b16-bbcf7b67aab9 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122152024-11-07T22:57:38.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 89b5e3e4-1dde-43d5-9e21-ea1f00b7e112 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122162024-11-07T22:57:38.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 89b5e3e4-1dde-43d5-9e21-ea1f00b7e112 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122172024-11-07T22:57:38.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2580 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 89b5e3e4-1dde-43d5-9e21-ea1f00b7e112 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122182024-11-07T22:57:39.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9b53f045-c484-40a5-9179-a1103de2718c roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122192024-11-07T22:57:39.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9b53f045-c484-40a5-9179-a1103de2718c resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122202024-11-07T22:57:39.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 9b53f045-c484-40a5-9179-a1103de2718c response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122212024-11-07T22:57:40.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6589c9f6-d81c-486f-9452-440e9ed678d8 roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122222024-11-07T22:57:40.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6589c9f6-d81c-486f-9452-440e9ed678d8 resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122232024-11-07T22:57:40.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 6589c9f6-d81c-486f-9452-440e9ed678d8 response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122242024-11-07T22:57:40.818ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
122252024-11-07T22:57:40.818ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
122262024-11-07T22:57:40.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122272024-11-07T22:57:40.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122282024-11-07T22:57:40.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122292024-11-07T22:57:40.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122302024-11-07T22:57:40.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122312024-11-07T22:57:40.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122322024-11-07T22:57:40.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122332024-11-07T22:57:40.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 47.953054ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
122342024-11-07T22:57:40.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
122352024-11-07T22:57:40.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122362024-11-07T22:57:40.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122372024-11-07T22:57:40.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122382024-11-07T22:57:40.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122392024-11-07T22:57:40.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122402024-11-07T22:57:40.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 504f485e-cebb-4a9f-9b69-4cc6af023531, lookup_type: ById(504f485e-cebb-4a9f-9b69-4cc6af023531) } result = Ok(())
122412024-11-07T22:57:40.874ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122422024-11-07T22:57:40.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122432024-11-07T22:57:40.883ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 original_time_created = 2024-11-07 22:42:38.884731 UTC target_id = 504f485e-cebb-4a9f-9b69-4cc6af023531 time_created = 2024-11-07 22:42:38.884731 UTC
122442024-11-07T22:57:40.883ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 64.926972ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"504f485e-cebb-4a9f-9b69-4cc6af023531","time_created":"2024-11-07T22:42:38.884731Z"}
122452024-11-07T22:57:41.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 19df11b4-e8ad-4678-8651-3c829145209a roles = RoleSet { roles: {} } uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122462024-11-07T22:57:41.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 19df11b4-e8ad-4678-8651-3c829145209a resource = Database result = Ok(()) uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1
122472024-11-07T22:57:41.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49347 req_id = 19df11b4-e8ad-4678-8651-3c829145209a response_code = 200 uri = /probes/c1e85b8f-73ff-449f-b9a8-ac0480ffdec1