(stdout not captured) (stderr not captured) (stdout not captured) (stderr not captured) running 1 test test tests::test_apis_up_to_date ... FAILED failures: failures: tests::test_apis_up_to_date test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 10.56s ------- Generating OpenAPI documents from API definitions ... Loading local OpenAPI documents from "/work/oxidecomputer/omicron/openapi" ... Loading blessed OpenAPI documents from VCS revision "origin/main" path "openapi" ------- Checking 94 OpenAPI documents... Fresh bootstrap-agent (versioned v2.0.0 (blessed)): Bootstrap Agent API Fresh bootstrap-agent "latest" symlink Fresh bootstrap-agent-lockstep (lockstep v0.0.1): Bootstrap Agent Lockstep API Fresh clickhouse-admin-keeper (versioned v1.0.0 (blessed)): ClickHouse Cluster Admin Keeper API Fresh clickhouse-admin-keeper "latest" symlink Fresh clickhouse-admin-server (versioned v1.0.0 (blessed)): ClickHouse Cluster Admin Server API Fresh clickhouse-admin-server "latest" symlink Fresh clickhouse-admin-single (versioned v1.0.0 (blessed)): ClickHouse Single-Node Admin Server API Fresh clickhouse-admin-single "latest" symlink Fresh cockroach-admin (versioned v1.0.0 (blessed)): CockroachDB Cluster Admin API Fresh cockroach-admin (versioned v2.0.0 (blessed)): CockroachDB Cluster Admin API Fresh cockroach-admin "latest" symlink Fresh dns-server (versioned v1.0.0 (blessed)): Internal DNS Fresh dns-server (versioned v2.0.0 (blessed)): Internal DNS Fresh dns-server "latest" symlink Fresh gateway (versioned v1.0.0 (blessed)): Oxide Management Gateway Service API Fresh gateway (versioned v2.0.0 (blessed)): Oxide Management Gateway Service API Fresh gateway (versioned v3.0.0 (blessed)): Oxide Management Gateway Service API Fresh gateway "latest" symlink Fresh installinator (versioned v1.0.0 (blessed)): Installinator API Fresh installinator "latest" symlink Fresh nexus (versioned v2025112000.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2025120300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2025121200.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2025122300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026010100.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026010300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026010500.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026010800.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026011100.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026011300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026011500.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026011501.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026011600.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026011601.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026012100.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026012200.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026012201.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026012300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026012800.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026013000.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026013001.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026013100.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026020200.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026020600.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026020900.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026020901.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026021300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026021301.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026021900.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026022500.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026030200.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026030600.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026030601.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026031200.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026031400.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026032300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026032400.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026032500.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026041600.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026041900.0.0 (blessed)): Oxide Region API Fresh nexus "latest" symlink Fresh nexus-internal (versioned v1.0.0 (blessed)): Nexus internal API Fresh nexus-internal "latest" symlink Stale nexus-lockstep (lockstep v0.0.1): Nexus lockstep API problem: For this lockstep API, OpenAPI document generated from the current code does not match the local file: "nexus- lockstep.json". This tool can update the local file for you. fix: will rewrite lockstep file nexus-lockstep.json from generated --- /work/oxidecomputer/omicron/openapi/nexus-lockstep.json +++ /work/oxidecomputer/omicron/openapi/nexus-lockstep.json @@ -8358,6 +8358,9 @@ "ReconfiguratorConfig": { "type": "object", "properties": { + "disruption_policy": { + "$ref": "#/components/schemas/ReconfiguratorDisruptionPolicy" + }, "planner_config": { "$ref": "#/components/schemas/PlannerConfig" }, @@ -8369,6 +8372,7 @@ } }, "required": [ + "disruption_policy", "planner_config", "planner_enabled", "tuf_repo_pruner_enabled" @@ -8413,6 +8417,32 @@ "version" ] }, + "ReconfiguratorDisruptionPolicy": { + "description": "Controls how instances are disrupted during updates.", + "oneOf": [ + { + "description": "Terminate instances during updates -- do not attempt to migrate instances. This is currently the default.", + "type": "string", + "enum": [ + "terminate" + ] + }, + { + "description": "Attempt to live-migrate instances, and terminate instances if migration is not possible (XXX due to???).", + "type": "string", + "enum": [ + "migrate_or_terminate" + ] + }, + { + "description": "Live-migrate (XXX migratable?) instances and don't ever terminate them.", + "type": "string", + "enum": [ + "migrate_only" + ] + } + ] + }, "RecoverySiloConfig": { "description": "Configuration for the recovery silo created during rack setup.", "type": "object", Fresh ntp-admin (versioned v1.0.0 (blessed)): NTP Admin API Fresh ntp-admin "latest" symlink Fresh oximeter (versioned v1.0.0 (blessed)): Oxide Oximeter API Fresh oximeter "latest" symlink Fresh repo-depot (versioned v1.0.0 (blessed)): Oxide TUF Repo Depot API Fresh repo-depot "latest" symlink Fresh sled-agent (versioned v1.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v2.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v3.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v4.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v5.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v6.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v7.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v8.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v9.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v10.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v11.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v12.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v13.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v14.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v15.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v16.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v17.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v18.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v19.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v20.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v21.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v22.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v23.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v24.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v25.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v26.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v27.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v28.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v29.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v30.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v31.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v32.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v33.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v34.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v35.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent "latest" symlink Fresh wicketd (lockstep v0.0.1): Oxide Technician Port Control Service ------- Stale 94 documents checked: 107 fresh, 1 stale, 0 failed, 0 other problems (run cargo xtask openapi generate to update) running 1 test test tests::test_apis_up_to_date ... FAILED failures: failures: tests::test_apis_up_to_date test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 9.99s ------- Generating OpenAPI documents from API definitions ... Loading local OpenAPI documents from "/work/oxidecomputer/omicron/openapi" ... Loading blessed OpenAPI documents from VCS revision "origin/main" path "openapi" ------- Checking 94 OpenAPI documents... Fresh bootstrap-agent (versioned v2.0.0 (blessed)): Bootstrap Agent API Fresh bootstrap-agent "latest" symlink Fresh bootstrap-agent-lockstep (lockstep v0.0.1): Bootstrap Agent Lockstep API Fresh clickhouse-admin-keeper (versioned v1.0.0 (blessed)): ClickHouse Cluster Admin Keeper API Fresh clickhouse-admin-keeper "latest" symlink Fresh clickhouse-admin-server (versioned v1.0.0 (blessed)): ClickHouse Cluster Admin Server API Fresh clickhouse-admin-server "latest" symlink Fresh clickhouse-admin-single (versioned v1.0.0 (blessed)): ClickHouse Single-Node Admin Server API Fresh clickhouse-admin-single "latest" symlink Fresh cockroach-admin (versioned v1.0.0 (blessed)): CockroachDB Cluster Admin API Fresh cockroach-admin (versioned v2.0.0 (blessed)): CockroachDB Cluster Admin API Fresh cockroach-admin "latest" symlink Fresh dns-server (versioned v1.0.0 (blessed)): Internal DNS Fresh dns-server (versioned v2.0.0 (blessed)): Internal DNS Fresh dns-server "latest" symlink Fresh gateway (versioned v1.0.0 (blessed)): Oxide Management Gateway Service API Fresh gateway (versioned v2.0.0 (blessed)): Oxide Management Gateway Service API Fresh gateway (versioned v3.0.0 (blessed)): Oxide Management Gateway Service API Fresh gateway "latest" symlink Fresh installinator (versioned v1.0.0 (blessed)): Installinator API Fresh installinator "latest" symlink Fresh nexus (versioned v2025112000.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2025120300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2025121200.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2025122300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026010100.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026010300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026010500.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026010800.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026011100.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026011300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026011500.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026011501.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026011600.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026011601.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026012100.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026012200.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026012201.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026012300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026012800.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026013000.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026013001.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026013100.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026020200.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026020600.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026020900.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026020901.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026021300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026021301.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026021900.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026022500.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026030200.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026030600.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026030601.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026031200.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026031400.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026032300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026032400.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026032500.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026041600.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026041900.0.0 (blessed)): Oxide Region API Fresh nexus "latest" symlink Fresh nexus-internal (versioned v1.0.0 (blessed)): Nexus internal API Fresh nexus-internal "latest" symlink Stale nexus-lockstep (lockstep v0.0.1): Nexus lockstep API problem: For this lockstep API, OpenAPI document generated from the current code does not match the local file: "nexus- lockstep.json". This tool can update the local file for you. fix: will rewrite lockstep file nexus-lockstep.json from generated --- /work/oxidecomputer/omicron/openapi/nexus-lockstep.json +++ /work/oxidecomputer/omicron/openapi/nexus-lockstep.json @@ -8358,6 +8358,9 @@ "ReconfiguratorConfig": { "type": "object", "properties": { + "disruption_policy": { + "$ref": "#/components/schemas/ReconfiguratorDisruptionPolicy" + }, "planner_config": { "$ref": "#/components/schemas/PlannerConfig" }, @@ -8369,6 +8372,7 @@ } }, "required": [ + "disruption_policy", "planner_config", "planner_enabled", "tuf_repo_pruner_enabled" @@ -8413,6 +8417,32 @@ "version" ] }, + "ReconfiguratorDisruptionPolicy": { + "description": "Controls how instances are disrupted during updates.", + "oneOf": [ + { + "description": "Terminate instances during updates -- do not attempt to migrate instances. This is currently the default.", + "type": "string", + "enum": [ + "terminate" + ] + }, + { + "description": "Attempt to live-migrate instances, and terminate instances if migration is not possible (XXX due to???).", + "type": "string", + "enum": [ + "migrate_or_terminate" + ] + }, + { + "description": "Live-migrate (XXX migratable?) instances and don't ever terminate them.", + "type": "string", + "enum": [ + "migrate_only" + ] + } + ] + }, "RecoverySiloConfig": { "description": "Configuration for the recovery silo created during rack setup.", "type": "object", Fresh ntp-admin (versioned v1.0.0 (blessed)): NTP Admin API Fresh ntp-admin "latest" symlink Fresh oximeter (versioned v1.0.0 (blessed)): Oxide Oximeter API Fresh oximeter "latest" symlink Fresh repo-depot (versioned v1.0.0 (blessed)): Oxide TUF Repo Depot API Fresh repo-depot "latest" symlink Fresh sled-agent (versioned v1.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v2.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v3.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v4.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v5.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v6.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v7.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v8.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v9.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v10.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v11.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v12.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v13.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v14.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v15.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v16.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v17.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v18.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v19.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v20.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v21.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v22.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v23.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v24.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v25.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v26.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v27.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v28.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v29.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v30.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v31.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v32.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v33.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v34.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v35.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent "latest" symlink Fresh wicketd (lockstep v0.0.1): Oxide Technician Port Control Service ------- Stale 94 documents checked: 107 fresh, 1 stale, 0 failed, 0 other problems (run cargo xtask openapi generate to update) running 1 test test tests::test_apis_up_to_date ... FAILED failures: failures: tests::test_apis_up_to_date test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 11.45s ------- Generating OpenAPI documents from API definitions ... Loading local OpenAPI documents from "/work/oxidecomputer/omicron/openapi" ... Loading blessed OpenAPI documents from VCS revision "origin/main" path "openapi" ------- Checking 94 OpenAPI documents... Fresh bootstrap-agent (versioned v2.0.0 (blessed)): Bootstrap Agent API Fresh bootstrap-agent "latest" symlink Fresh bootstrap-agent-lockstep (lockstep v0.0.1): Bootstrap Agent Lockstep API Fresh clickhouse-admin-keeper (versioned v1.0.0 (blessed)): ClickHouse Cluster Admin Keeper API Fresh clickhouse-admin-keeper "latest" symlink Fresh clickhouse-admin-server (versioned v1.0.0 (blessed)): ClickHouse Cluster Admin Server API Fresh clickhouse-admin-server "latest" symlink Fresh clickhouse-admin-single (versioned v1.0.0 (blessed)): ClickHouse Single-Node Admin Server API Fresh clickhouse-admin-single "latest" symlink Fresh cockroach-admin (versioned v1.0.0 (blessed)): CockroachDB Cluster Admin API Fresh cockroach-admin (versioned v2.0.0 (blessed)): CockroachDB Cluster Admin API Fresh cockroach-admin "latest" symlink Fresh dns-server (versioned v1.0.0 (blessed)): Internal DNS Fresh dns-server (versioned v2.0.0 (blessed)): Internal DNS Fresh dns-server "latest" symlink Fresh gateway (versioned v1.0.0 (blessed)): Oxide Management Gateway Service API Fresh gateway (versioned v2.0.0 (blessed)): Oxide Management Gateway Service API Fresh gateway (versioned v3.0.0 (blessed)): Oxide Management Gateway Service API Fresh gateway "latest" symlink Fresh installinator (versioned v1.0.0 (blessed)): Installinator API Fresh installinator "latest" symlink Fresh nexus (versioned v2025112000.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2025120300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2025121200.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2025122300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026010100.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026010300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026010500.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026010800.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026011100.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026011300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026011500.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026011501.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026011600.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026011601.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026012100.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026012200.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026012201.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026012300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026012800.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026013000.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026013001.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026013100.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026020200.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026020600.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026020900.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026020901.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026021300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026021301.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026021900.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026022500.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026030200.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026030600.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026030601.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026031200.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026031400.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026032300.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026032400.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026032500.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026041600.0.0 (blessed)): Oxide Region API Fresh nexus (versioned v2026041900.0.0 (blessed)): Oxide Region API Fresh nexus "latest" symlink Fresh nexus-internal (versioned v1.0.0 (blessed)): Nexus internal API Fresh nexus-internal "latest" symlink Stale nexus-lockstep (lockstep v0.0.1): Nexus lockstep API problem: For this lockstep API, OpenAPI document generated from the current code does not match the local file: "nexus- lockstep.json". This tool can update the local file for you. fix: will rewrite lockstep file nexus-lockstep.json from generated --- /work/oxidecomputer/omicron/openapi/nexus-lockstep.json +++ /work/oxidecomputer/omicron/openapi/nexus-lockstep.json @@ -8358,6 +8358,9 @@ "ReconfiguratorConfig": { "type": "object", "properties": { + "disruption_policy": { + "$ref": "#/components/schemas/ReconfiguratorDisruptionPolicy" + }, "planner_config": { "$ref": "#/components/schemas/PlannerConfig" }, @@ -8369,6 +8372,7 @@ } }, "required": [ + "disruption_policy", "planner_config", "planner_enabled", "tuf_repo_pruner_enabled" @@ -8413,6 +8417,32 @@ "version" ] }, + "ReconfiguratorDisruptionPolicy": { + "description": "Controls how instances are disrupted during updates.", + "oneOf": [ + { + "description": "Terminate instances during updates -- do not attempt to migrate instances. This is currently the default.", + "type": "string", + "enum": [ + "terminate" + ] + }, + { + "description": "Attempt to live-migrate instances, and terminate instances if migration is not possible (XXX due to???).", + "type": "string", + "enum": [ + "migrate_or_terminate" + ] + }, + { + "description": "Live-migrate (XXX migratable?) instances and don't ever terminate them.", + "type": "string", + "enum": [ + "migrate_only" + ] + } + ] + }, "RecoverySiloConfig": { "description": "Configuration for the recovery silo created during rack setup.", "type": "object", Fresh ntp-admin (versioned v1.0.0 (blessed)): NTP Admin API Fresh ntp-admin "latest" symlink Fresh oximeter (versioned v1.0.0 (blessed)): Oxide Oximeter API Fresh oximeter "latest" symlink Fresh repo-depot (versioned v1.0.0 (blessed)): Oxide TUF Repo Depot API Fresh repo-depot "latest" symlink Fresh sled-agent (versioned v1.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v2.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v3.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v4.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v5.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v6.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v7.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v8.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v9.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v10.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v11.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v12.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v13.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v14.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v15.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v16.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v17.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v18.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v19.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v20.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v21.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v22.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v23.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v24.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v25.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v26.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v27.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v28.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v29.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v30.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v31.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v32.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v33.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v34.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent (versioned v35.0.0 (blessed)): Oxide Sled Agent API Fresh sled-agent "latest" symlink Fresh wicketd (lockstep v0.0.1): Oxide Technician Port Control Service ------- Stale 94 documents checked: 107 fresh, 1 stale, 0 failed, 0 other problems (run cargo xtask openapi generate to update) thread 'test_omdb_success_cases' (363264) panicked at dev-tools/omdb/tests/test_all_output.rs:407:5: assertion failed: string doesn't match the contents of file: "tests/successes.out" see diffset above set EXPECTORATE=overwrite if these changes are intentional stack backtrace: 0: __rustc::rust_begin_unwind at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/std/src/panicking.rs:689:5 1: core::panicking::panic_fmt at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/panicking.rs:80:14 2: expectorate::assert_contents::<&str> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/expectorate-1.2.0/src/lib.rs:67:9 3: {async_block#0} at ./tests/test_all_output.rs:407:5 4: poll<&mut dyn core::future::future::Future<Output=()>> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/future/future.rs:133:9 5: poll<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/future/future.rs:133:9 6: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:778:70 7: with_budget<core::task::poll::Poll<()>, tokio::runtime::scheduler::current_thread::{impl#9}::block_on::{closure#0}::{closure#0}::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/task/coop/mod.rs:167:5 8: budget<core::task::poll::Poll<()>, tokio::runtime::scheduler::current_thread::{impl#9}::block_on::{closure#0}::{closure#0}::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/task/coop/mod.rs:133:5 9: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:778:25 10: <tokio::runtime::scheduler::current_thread::Context>::enter::<core::task::poll::Poll<()>, <tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}::{closure#0}> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:451:19 11: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:777:44 12: <tokio::runtime::scheduler::current_thread::CoreGuard>::enter::<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0} at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:865:68 13: <tokio::runtime::context::scoped::Scoped<tokio::runtime::scheduler::Context>>::set::<<tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>)> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context/scoped.rs:40:9 14: tokio::runtime::context::set_scheduler::<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>), <tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}>::{closure#0} at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context.rs:181:38 15: try_with<tokio::runtime::context::Context, tokio::runtime::context::set_scheduler::{closure_env#0}<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>), tokio::runtime::scheduler::current_thread::{impl#9}::enter::{closure_env#0}<tokio::runtime::scheduler::current_thread::{impl#9}::block_on::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>, core::option::Option<()>>>, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>)> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/std/src/thread/local.rs:513:12 16: <std::thread::local::LocalKey<tokio::runtime::context::Context>>::with::<tokio::runtime::context::set_scheduler<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>), <tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}>::{closure#0}, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>)> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/std/src/thread/local.rs:477:20 17: tokio::runtime::context::set_scheduler::<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>), <tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context.rs:181:17 18: <tokio::runtime::scheduler::current_thread::CoreGuard>::enter::<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:865:27 19: <tokio::runtime::scheduler::current_thread::CoreGuard>::block_on::<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:765:24 20: {closure#0}<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:205:33 21: tokio::runtime::context::runtime::enter_runtime::<<tokio::runtime::scheduler::current_thread::CurrentThread>::block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>::{closure#0}, ()> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context/runtime.rs:65:16 22: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:193:9 23: <tokio::runtime::runtime::Runtime>::block_on_inner::<core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/runtime.rs:371:52 24: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/runtime.rs:345:18 25: test_omdb_success_cases at ./tests/test_all_output.rs:461:31 26: test_all_output::test_omdb_success_cases::{closure#0} at ./tests/test_all_output.rs:135:35 27: <test_all_output::test_omdb_success_cases::{closure#0} as core::ops::function::FnOnce<()>>::call_once at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/ops/function.rs:250:5 28: core::ops::function::FnOnce::call_once at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/ops/function.rs:250:5 note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace. WARN: dropped CockroachInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: temporary directory leaked: "/var/tmp/omicron_tmp/.tmpK5xbae" If you would like to access the database for debugging, run the following: # Run the database cargo xtask db-dev run --no-populate --store-dir "/var/tmp/omicron_tmp/.tmpK5xbae/data" # Access the database. Note the port may change if you run multiple databases. cockroach sql --host=localhost:32221 --insecure WARN: dropped ClickHouse process without cleaning it up first (there may still be a child process running (PID 363868) and a temporary directory leaked, /var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.363263.1-clickhouse-6EhQMo) WARN: dropped DendriteInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: dendrite temporary directory leaked: /var/tmp/omicron_tmp/.tmpI3RuoG WARN: dropped DendriteInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: dendrite temporary directory leaked: /var/tmp/omicron_tmp/.tmpE5kEJe WARN: dropped MgdInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: mgd temporary directory leaked: /var/tmp/omicron_tmp/.tmpM7ZgUw WARN: dropped MgdInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: mgd temporary directory leaked: /var/tmp/omicron_tmp/.tmp2HZakW thread 'test_omdb_success_cases' (384128) panicked at dev-tools/omdb/tests/test_all_output.rs:407:5: assertion failed: string doesn't match the contents of file: "tests/successes.out" see diffset above set EXPECTORATE=overwrite if these changes are intentional stack backtrace: 0: __rustc::rust_begin_unwind at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/std/src/panicking.rs:689:5 1: core::panicking::panic_fmt at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/panicking.rs:80:14 2: expectorate::assert_contents::<&str> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/expectorate-1.2.0/src/lib.rs:67:9 3: {async_block#0} at ./tests/test_all_output.rs:407:5 4: poll<&mut dyn core::future::future::Future<Output=()>> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/future/future.rs:133:9 5: poll<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/future/future.rs:133:9 6: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:778:70 7: with_budget<core::task::poll::Poll<()>, tokio::runtime::scheduler::current_thread::{impl#9}::block_on::{closure#0}::{closure#0}::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/task/coop/mod.rs:167:5 8: budget<core::task::poll::Poll<()>, tokio::runtime::scheduler::current_thread::{impl#9}::block_on::{closure#0}::{closure#0}::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/task/coop/mod.rs:133:5 9: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:778:25 10: <tokio::runtime::scheduler::current_thread::Context>::enter::<core::task::poll::Poll<()>, <tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}::{closure#0}> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:451:19 11: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:777:44 12: <tokio::runtime::scheduler::current_thread::CoreGuard>::enter::<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0} at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:865:68 13: <tokio::runtime::context::scoped::Scoped<tokio::runtime::scheduler::Context>>::set::<<tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>)> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context/scoped.rs:40:9 14: tokio::runtime::context::set_scheduler::<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>), <tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}>::{closure#0} at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context.rs:181:38 15: try_with<tokio::runtime::context::Context, tokio::runtime::context::set_scheduler::{closure_env#0}<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>), tokio::runtime::scheduler::current_thread::{impl#9}::enter::{closure_env#0}<tokio::runtime::scheduler::current_thread::{impl#9}::block_on::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>, core::option::Option<()>>>, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>)> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/std/src/thread/local.rs:513:12 16: <std::thread::local::LocalKey<tokio::runtime::context::Context>>::with::<tokio::runtime::context::set_scheduler<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>), <tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}>::{closure#0}, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>)> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/std/src/thread/local.rs:477:20 17: tokio::runtime::context::set_scheduler::<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>), <tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context.rs:181:17 18: <tokio::runtime::scheduler::current_thread::CoreGuard>::enter::<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:865:27 19: <tokio::runtime::scheduler::current_thread::CoreGuard>::block_on::<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:765:24 20: {closure#0}<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:205:33 21: tokio::runtime::context::runtime::enter_runtime::<<tokio::runtime::scheduler::current_thread::CurrentThread>::block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>::{closure#0}, ()> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context/runtime.rs:65:16 22: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:193:9 23: <tokio::runtime::runtime::Runtime>::block_on_inner::<core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/runtime.rs:371:52 24: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/runtime.rs:345:18 25: test_omdb_success_cases at ./tests/test_all_output.rs:461:31 26: test_all_output::test_omdb_success_cases::{closure#0} at ./tests/test_all_output.rs:135:35 27: <test_all_output::test_omdb_success_cases::{closure#0} as core::ops::function::FnOnce<()>>::call_once at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/ops/function.rs:250:5 28: core::ops::function::FnOnce::call_once at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/ops/function.rs:250:5 note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace. WARN: dropped CockroachInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: temporary directory leaked: "/var/tmp/omicron_tmp/.tmph1pXNC" If you would like to access the database for debugging, run the following: # Run the database cargo xtask db-dev run --no-populate --store-dir "/var/tmp/omicron_tmp/.tmph1pXNC/data" # Access the database. Note the port may change if you run multiple databases. cockroach sql --host=localhost:32221 --insecure WARN: dropped ClickHouse process without cleaning it up first (there may still be a child process running (PID 384623) and a temporary directory leaked, /var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.384127.1-clickhouse-ys2f8S) WARN: dropped DendriteInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: dendrite temporary directory leaked: /var/tmp/omicron_tmp/.tmpWirKtq WARN: dropped DendriteInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: dendrite temporary directory leaked: /var/tmp/omicron_tmp/.tmpW14c5o WARN: dropped MgdInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: mgd temporary directory leaked: /var/tmp/omicron_tmp/.tmpi9HII4 WARN: dropped MgdInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: mgd temporary directory leaked: /var/tmp/omicron_tmp/.tmptF88oI running 1 test running commands with args: ["db", "db-metadata", "ls-nexus"] running commands with args: ["--destructive", "db", "db-metadata", "force-mark-nexus-quiesced", "--skip-confirmation", "913233fe-92a8-4635-9572-183f495429c4"] running commands with args: ["db", "disks", "list"] running commands with args: ["db", "dns", "show"] running commands with args: ["db", "dns", "diff", "external", "2"] running commands with args: ["db", "dns", "names", "external", "2"] running commands with args: ["db", "instances"] running commands with args: ["db", "sleds"] running commands with args: ["db", "sleds", "-F", "discretionary"] running commands with args: ["mgs", "inventory"] running commands with args: ["nexus", "background-tasks", "doc"] running commands with args: ["nexus", "background-tasks", "show", "--no-executing-info"] running commands with args: ["nexus", "background-tasks", "show", "saga_recovery", "--no-executing-info"] running commands with args: ["nexus", "background-tasks", "show", "blueprint_loader", "blueprint_executor", "--no-executing-info"] running commands with args: ["nexus", "background-tasks", "show", "dns_internal", "--no-executing-info"] running commands with args: ["nexus", "background-tasks", "show", "dns_external", "--no-executing-info"] running commands with args: ["nexus", "background-tasks", "show", "all", "--no-executing-info"] running commands with args: ["nexus", "sagas", "list"] running commands with args: ["--destructive", "nexus", "sagas", "demo-create"] running commands with args: ["nexus", "sagas", "list"] running commands with args: ["--destructive", "nexus", "background-tasks", "activate", "inventory_collection"] running commands with args: ["nexus", "blueprints", "list"] running commands with args: ["nexus", "blueprints", "show", "1382f6ee-0ae9-47ec-9d30-96e991baf51f"] running commands with args: ["nexus", "blueprints", "show", "current-target"] running commands with args: ["nexus", "blueprints", "diff", "1382f6ee-0ae9-47ec-9d30-96e991baf51f", "current-target"] running commands with args: ["nexus", "blueprints", "diff", "1382f6ee-0ae9-47ec-9d30-96e991baf51f"] running commands with args: ["nexus", "reconfigurator-config", "show", "current"] running commands with args: ["nexus", "update-status"] running commands with args: ["nexus", "update-status", "--details"] running commands with args: ["-w", "nexus", "reconfigurator-config", "set", "--planner-enabled", "true"] running commands with args: ["-w", "nexus", "reconfigurator-config", "set", "--add-zones-with-mupdate-override", "true"] running commands with args: ["nexus", "reconfigurator-config", "show", "current"] running commands with args: ["reconfigurator", "export", "/var/tmp/omicron_tmp/.tmpSDjTDL/reconfigurator-export.out"] running commands with args: ["db", "whatis", "001de000-5110-4000-8000-000000000000", "001de000-05e4-4000-8000-000000004007"] running commands with args: ["--destructive", "db", "db-metadata", "force-mark-nexus-quiesced", "--skip-confirmation", "--skip-blueprint-validation", "913233fe-92a8-4635-9572-183f495429c4"] @@ -2134,10 +2134,11 @@ stdout: Reconfigurator config: version: 1 modified time: <REDACTED_TIMESTAMP> tuf repo pruner enabled: true + disruption policy: terminate planner enabled: false planner config: add zones with mupdate override: false --------------------------------------------- stderr: @@ -2216,10 +2217,11 @@ --------------------------------------------- stdout: reconfigurator config updated to version 2: tuf repo pruner enabled: true (unchanged) * planner enabled::::::::: false -> true + disruption policy::::::: terminate (unchanged) planner config: add zones with mupdate override: false (unchanged) --------------------------------------------- stderr: note: using Nexus URL http://127.0.0.1:REDACTED_PORT/ @@ -2229,10 +2231,11 @@ --------------------------------------------- stdout: reconfigurator config updated to version 3: tuf repo pruner enabled: true (unchanged) planner enabled::::::::: true (unchanged) + disruption policy::::::: terminate (unchanged) planner config: * add zones with mupdate override: false -> true --------------------------------------------- stderr: note: using Nexus URL http://127.0.0.1:REDACTED_PORT/ @@ -2243,10 +2246,11 @@ stdout: Reconfigurator config: version: 3 modified time: <REDACTED_TIMESTAMP> tuf repo pruner enabled: true + disruption policy: terminate planner enabled: true planner config: add zones with mupdate override: true --------------------------------------------- stderr: test test_omdb_success_cases ... FAILED failures: failures: test_omdb_success_cases test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 2 filtered out; finished in 17.15s log file: /var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.384127.0.log note: configured to log to "/var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.384127.0.log" DB URL: postgresql://root@[::1]:40913/omicron?sslmode=disable DB address: [::1]:40913 log file: /var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.384127.2.log note: configured to log to "/var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.384127.2.log" log file: /var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.384127.3.log note: configured to log to "/var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.384127.3.log" thread 'test_omdb_success_cases' (384128) panicked at dev-tools/omdb/tests/test_all_output.rs:407:5: assertion failed: string doesn't match the contents of file: "tests/successes.out" see diffset above set EXPECTORATE=overwrite if these changes are intentional stack backtrace: 0: __rustc::rust_begin_unwind at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/std/src/panicking.rs:689:5 1: core::panicking::panic_fmt at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/panicking.rs:80:14 2: expectorate::assert_contents::<&str> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/expectorate-1.2.0/src/lib.rs:67:9 3: {async_block#0} at ./tests/test_all_output.rs:407:5 4: poll<&mut dyn core::future::future::Future<Output=()>> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/future/future.rs:133:9 5: poll<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/future/future.rs:133:9 6: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:778:70 7: with_budget<core::task::poll::Poll<()>, tokio::runtime::scheduler::current_thread::{impl#9}::block_on::{closure#0}::{closure#0}::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/task/coop/mod.rs:167:5 8: budget<core::task::poll::Poll<()>, tokio::runtime::scheduler::current_thread::{impl#9}::block_on::{closure#0}::{closure#0}::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/task/coop/mod.rs:133:5 9: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:778:25 10: <tokio::runtime::scheduler::current_thread::Context>::enter::<core::task::poll::Poll<()>, <tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}::{closure#0}> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:451:19 11: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:777:44 12: <tokio::runtime::scheduler::current_thread::CoreGuard>::enter::<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0} at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:865:68 13: <tokio::runtime::context::scoped::Scoped<tokio::runtime::scheduler::Context>>::set::<<tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>)> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context/scoped.rs:40:9 14: tokio::runtime::context::set_scheduler::<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>), <tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}>::{closure#0} at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context.rs:181:38 15: try_with<tokio::runtime::context::Context, tokio::runtime::context::set_scheduler::{closure_env#0}<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>), tokio::runtime::scheduler::current_thread::{impl#9}::enter::{closure_env#0}<tokio::runtime::scheduler::current_thread::{impl#9}::block_on::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>, core::option::Option<()>>>, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>)> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/std/src/thread/local.rs:513:12 16: <std::thread::local::LocalKey<tokio::runtime::context::Context>>::with::<tokio::runtime::context::set_scheduler<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>), <tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}>::{closure#0}, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>)> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/std/src/thread/local.rs:477:20 17: tokio::runtime::context::set_scheduler::<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>), <tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context.rs:181:17 18: <tokio::runtime::scheduler::current_thread::CoreGuard>::enter::<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:865:27 19: <tokio::runtime::scheduler::current_thread::CoreGuard>::block_on::<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:765:24 20: {closure#0}<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:205:33 21: tokio::runtime::context::runtime::enter_runtime::<<tokio::runtime::scheduler::current_thread::CurrentThread>::block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>::{closure#0}, ()> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context/runtime.rs:65:16 22: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:193:9 23: <tokio::runtime::runtime::Runtime>::block_on_inner::<core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/runtime.rs:371:52 24: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/runtime.rs:345:18 25: test_omdb_success_cases at ./tests/test_all_output.rs:461:31 26: test_all_output::test_omdb_success_cases::{closure#0} at ./tests/test_all_output.rs:135:35 27: <test_all_output::test_omdb_success_cases::{closure#0} as core::ops::function::FnOnce<()>>::call_once at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/ops/function.rs:250:5 28: core::ops::function::FnOnce::call_once at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/ops/function.rs:250:5 note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace. WARN: dropped CockroachInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: temporary directory leaked: "/var/tmp/omicron_tmp/.tmph1pXNC" If you would like to access the database for debugging, run the following: # Run the database cargo xtask db-dev run --no-populate --store-dir "/var/tmp/omicron_tmp/.tmph1pXNC/data" # Access the database. Note the port may change if you run multiple databases. cockroach sql --host=localhost:32221 --insecure WARN: dropped ClickHouse process without cleaning it up first (there may still be a child process running (PID 384623) and a temporary directory leaked, /var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.384127.1-clickhouse-ys2f8S) WARN: dropped DendriteInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: dendrite temporary directory leaked: /var/tmp/omicron_tmp/.tmpWirKtq WARN: dropped DendriteInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: dendrite temporary directory leaked: /var/tmp/omicron_tmp/.tmpW14c5o WARN: dropped MgdInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: mgd temporary directory leaked: /var/tmp/omicron_tmp/.tmpi9HII4 WARN: dropped MgdInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: mgd temporary directory leaked: /var/tmp/omicron_tmp/.tmptF88oI thread 'test_omdb_success_cases' (390419) panicked at dev-tools/omdb/tests/test_all_output.rs:407:5: assertion failed: string doesn't match the contents of file: "tests/successes.out" see diffset above set EXPECTORATE=overwrite if these changes are intentional stack backtrace: 0: __rustc::rust_begin_unwind at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/std/src/panicking.rs:689:5 1: core::panicking::panic_fmt at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/panicking.rs:80:14 2: expectorate::assert_contents::<&str> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/expectorate-1.2.0/src/lib.rs:67:9 3: {async_block#0} at ./tests/test_all_output.rs:407:5 4: poll<&mut dyn core::future::future::Future<Output=()>> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/future/future.rs:133:9 5: poll<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/future/future.rs:133:9 6: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:778:70 7: with_budget<core::task::poll::Poll<()>, tokio::runtime::scheduler::current_thread::{impl#9}::block_on::{closure#0}::{closure#0}::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/task/coop/mod.rs:167:5 8: budget<core::task::poll::Poll<()>, tokio::runtime::scheduler::current_thread::{impl#9}::block_on::{closure#0}::{closure#0}::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/task/coop/mod.rs:133:5 9: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:778:25 10: <tokio::runtime::scheduler::current_thread::Context>::enter::<core::task::poll::Poll<()>, <tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}::{closure#0}> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:451:19 11: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:777:44 12: <tokio::runtime::scheduler::current_thread::CoreGuard>::enter::<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0} at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:865:68 13: <tokio::runtime::context::scoped::Scoped<tokio::runtime::scheduler::Context>>::set::<<tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>)> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context/scoped.rs:40:9 14: tokio::runtime::context::set_scheduler::<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>), <tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}>::{closure#0} at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context.rs:181:38 15: try_with<tokio::runtime::context::Context, tokio::runtime::context::set_scheduler::{closure_env#0}<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>), tokio::runtime::scheduler::current_thread::{impl#9}::enter::{closure_env#0}<tokio::runtime::scheduler::current_thread::{impl#9}::block_on::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>, core::option::Option<()>>>, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>)> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/std/src/thread/local.rs:513:12 16: <std::thread::local::LocalKey<tokio::runtime::context::Context>>::with::<tokio::runtime::context::set_scheduler<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>), <tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}>::{closure#0}, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>)> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/std/src/thread/local.rs:477:20 17: tokio::runtime::context::set_scheduler::<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>), <tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context.rs:181:17 18: <tokio::runtime::scheduler::current_thread::CoreGuard>::enter::<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:865:27 19: <tokio::runtime::scheduler::current_thread::CoreGuard>::block_on::<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:765:24 20: {closure#0}<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:205:33 21: tokio::runtime::context::runtime::enter_runtime::<<tokio::runtime::scheduler::current_thread::CurrentThread>::block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>::{closure#0}, ()> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context/runtime.rs:65:16 22: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:193:9 23: <tokio::runtime::runtime::Runtime>::block_on_inner::<core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/runtime.rs:371:52 24: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/runtime.rs:345:18 25: test_omdb_success_cases at ./tests/test_all_output.rs:461:31 26: test_all_output::test_omdb_success_cases::{closure#0} at ./tests/test_all_output.rs:135:35 27: <test_all_output::test_omdb_success_cases::{closure#0} as core::ops::function::FnOnce<()>>::call_once at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/ops/function.rs:250:5 28: core::ops::function::FnOnce::call_once at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/ops/function.rs:250:5 note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace. WARN: dropped CockroachInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: temporary directory leaked: "/var/tmp/omicron_tmp/.tmpuJKMB0" If you would like to access the database for debugging, run the following: # Run the database cargo xtask db-dev run --no-populate --store-dir "/var/tmp/omicron_tmp/.tmpuJKMB0/data" # Access the database. Note the port may change if you run multiple databases. cockroach sql --host=localhost:32221 --insecure WARN: dropped ClickHouse process without cleaning it up first (there may still be a child process running (PID 390527) and a temporary directory leaked, /var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.390418.1-clickhouse-REy56G) WARN: dropped DendriteInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: dendrite temporary directory leaked: /var/tmp/omicron_tmp/.tmpQMuUi2 WARN: dropped DendriteInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: dendrite temporary directory leaked: /var/tmp/omicron_tmp/.tmpiFAjac WARN: dropped MgdInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: mgd temporary directory leaked: /var/tmp/omicron_tmp/.tmpONR12y WARN: dropped MgdInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: mgd temporary directory leaked: /var/tmp/omicron_tmp/.tmpFAqwzC running 1 test running commands with args: ["db", "db-metadata", "ls-nexus"] running commands with args: ["--destructive", "db", "db-metadata", "force-mark-nexus-quiesced", "--skip-confirmation", "913233fe-92a8-4635-9572-183f495429c4"] running commands with args: ["db", "disks", "list"] running commands with args: ["db", "dns", "show"] running commands with args: ["db", "dns", "diff", "external", "2"] running commands with args: ["db", "dns", "names", "external", "2"] running commands with args: ["db", "instances"] running commands with args: ["db", "sleds"] running commands with args: ["db", "sleds", "-F", "discretionary"] running commands with args: ["mgs", "inventory"] running commands with args: ["nexus", "background-tasks", "doc"] running commands with args: ["nexus", "background-tasks", "show", "--no-executing-info"] running commands with args: ["nexus", "background-tasks", "show", "saga_recovery", "--no-executing-info"] running commands with args: ["nexus", "background-tasks", "show", "blueprint_loader", "blueprint_executor", "--no-executing-info"] running commands with args: ["nexus", "background-tasks", "show", "dns_internal", "--no-executing-info"] running commands with args: ["nexus", "background-tasks", "show", "dns_external", "--no-executing-info"] running commands with args: ["nexus", "background-tasks", "show", "all", "--no-executing-info"] running commands with args: ["nexus", "sagas", "list"] running commands with args: ["--destructive", "nexus", "sagas", "demo-create"] running commands with args: ["nexus", "sagas", "list"] running commands with args: ["--destructive", "nexus", "background-tasks", "activate", "inventory_collection"] running commands with args: ["nexus", "blueprints", "list"] running commands with args: ["nexus", "blueprints", "show", "8d4f1d63-d1d1-411f-96b0-00b56483b70e"] running commands with args: ["nexus", "blueprints", "show", "current-target"] running commands with args: ["nexus", "blueprints", "diff", "8d4f1d63-d1d1-411f-96b0-00b56483b70e", "current-target"] running commands with args: ["nexus", "blueprints", "diff", "8d4f1d63-d1d1-411f-96b0-00b56483b70e"] running commands with args: ["nexus", "reconfigurator-config", "show", "current"] running commands with args: ["nexus", "update-status"] running commands with args: ["nexus", "update-status", "--details"] running commands with args: ["-w", "nexus", "reconfigurator-config", "set", "--planner-enabled", "true"] running commands with args: ["-w", "nexus", "reconfigurator-config", "set", "--add-zones-with-mupdate-override", "true"] running commands with args: ["nexus", "reconfigurator-config", "show", "current"] running commands with args: ["reconfigurator", "export", "/var/tmp/omicron_tmp/.tmpHt6wK5/reconfigurator-export.out"] running commands with args: ["db", "whatis", "001de000-5110-4000-8000-000000000000", "001de000-05e4-4000-8000-000000004007"] running commands with args: ["--destructive", "db", "db-metadata", "force-mark-nexus-quiesced", "--skip-confirmation", "--skip-blueprint-validation", "913233fe-92a8-4635-9572-183f495429c4"] @@ -2134,10 +2134,11 @@ stdout: Reconfigurator config: version: 1 modified time: <REDACTED_TIMESTAMP> tuf repo pruner enabled: true + disruption policy: terminate planner enabled: false planner config: add zones with mupdate override: false --------------------------------------------- stderr: @@ -2216,10 +2217,11 @@ --------------------------------------------- stdout: reconfigurator config updated to version 2: tuf repo pruner enabled: true (unchanged) * planner enabled::::::::: false -> true + disruption policy::::::: terminate (unchanged) planner config: add zones with mupdate override: false (unchanged) --------------------------------------------- stderr: note: using Nexus URL http://127.0.0.1:REDACTED_PORT/ @@ -2229,10 +2231,11 @@ --------------------------------------------- stdout: reconfigurator config updated to version 3: tuf repo pruner enabled: true (unchanged) planner enabled::::::::: true (unchanged) + disruption policy::::::: terminate (unchanged) planner config: * add zones with mupdate override: false -> true --------------------------------------------- stderr: note: using Nexus URL http://127.0.0.1:REDACTED_PORT/ @@ -2243,10 +2246,11 @@ stdout: Reconfigurator config: version: 3 modified time: <REDACTED_TIMESTAMP> tuf repo pruner enabled: true + disruption policy: terminate planner enabled: true planner config: add zones with mupdate override: true --------------------------------------------- stderr: test test_omdb_success_cases ... FAILED failures: failures: test_omdb_success_cases test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 2 filtered out; finished in 16.22s log file: /var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.390418.0.log note: configured to log to "/var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.390418.0.log" DB URL: postgresql://root@[::1]:36509/omicron?sslmode=disable DB address: [::1]:36509 log file: /var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.390418.2.log note: configured to log to "/var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.390418.2.log" log file: /var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.390418.3.log note: configured to log to "/var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.390418.3.log" thread 'test_omdb_success_cases' (390419) panicked at dev-tools/omdb/tests/test_all_output.rs:407:5: assertion failed: string doesn't match the contents of file: "tests/successes.out" see diffset above set EXPECTORATE=overwrite if these changes are intentional stack backtrace: 0: __rustc::rust_begin_unwind at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/std/src/panicking.rs:689:5 1: core::panicking::panic_fmt at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/panicking.rs:80:14 2: expectorate::assert_contents::<&str> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/expectorate-1.2.0/src/lib.rs:67:9 3: {async_block#0} at ./tests/test_all_output.rs:407:5 4: poll<&mut dyn core::future::future::Future<Output=()>> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/future/future.rs:133:9 5: poll<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/future/future.rs:133:9 6: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:778:70 7: with_budget<core::task::poll::Poll<()>, tokio::runtime::scheduler::current_thread::{impl#9}::block_on::{closure#0}::{closure#0}::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/task/coop/mod.rs:167:5 8: budget<core::task::poll::Poll<()>, tokio::runtime::scheduler::current_thread::{impl#9}::block_on::{closure#0}::{closure#0}::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/task/coop/mod.rs:133:5 9: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:778:25 10: <tokio::runtime::scheduler::current_thread::Context>::enter::<core::task::poll::Poll<()>, <tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}::{closure#0}> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:451:19 11: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:777:44 12: <tokio::runtime::scheduler::current_thread::CoreGuard>::enter::<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0} at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:865:68 13: <tokio::runtime::context::scoped::Scoped<tokio::runtime::scheduler::Context>>::set::<<tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>)> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context/scoped.rs:40:9 14: tokio::runtime::context::set_scheduler::<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>), <tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}>::{closure#0} at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context.rs:181:38 15: try_with<tokio::runtime::context::Context, tokio::runtime::context::set_scheduler::{closure_env#0}<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>), tokio::runtime::scheduler::current_thread::{impl#9}::enter::{closure_env#0}<tokio::runtime::scheduler::current_thread::{impl#9}::block_on::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>, core::option::Option<()>>>, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>)> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/std/src/thread/local.rs:513:12 16: <std::thread::local::LocalKey<tokio::runtime::context::Context>>::with::<tokio::runtime::context::set_scheduler<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>), <tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}>::{closure#0}, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>)> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/std/src/thread/local.rs:477:20 17: tokio::runtime::context::set_scheduler::<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>), <tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context.rs:181:17 18: <tokio::runtime::scheduler::current_thread::CoreGuard>::enter::<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:865:27 19: <tokio::runtime::scheduler::current_thread::CoreGuard>::block_on::<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:765:24 20: {closure#0}<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:205:33 21: tokio::runtime::context::runtime::enter_runtime::<<tokio::runtime::scheduler::current_thread::CurrentThread>::block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>::{closure#0}, ()> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context/runtime.rs:65:16 22: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:193:9 23: <tokio::runtime::runtime::Runtime>::block_on_inner::<core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/runtime.rs:371:52 24: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/runtime.rs:345:18 25: test_omdb_success_cases at ./tests/test_all_output.rs:461:31 26: test_all_output::test_omdb_success_cases::{closure#0} at ./tests/test_all_output.rs:135:35 27: <test_all_output::test_omdb_success_cases::{closure#0} as core::ops::function::FnOnce<()>>::call_once at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/ops/function.rs:250:5 28: core::ops::function::FnOnce::call_once at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/ops/function.rs:250:5 note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace. WARN: dropped CockroachInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: temporary directory leaked: "/var/tmp/omicron_tmp/.tmpuJKMB0" If you would like to access the database for debugging, run the following: # Run the database cargo xtask db-dev run --no-populate --store-dir "/var/tmp/omicron_tmp/.tmpuJKMB0/data" # Access the database. Note the port may change if you run multiple databases. cockroach sql --host=localhost:32221 --insecure WARN: dropped ClickHouse process without cleaning it up first (there may still be a child process running (PID 390527) and a temporary directory leaked, /var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.390418.1-clickhouse-REy56G) WARN: dropped DendriteInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: dendrite temporary directory leaked: /var/tmp/omicron_tmp/.tmpQMuUi2 WARN: dropped DendriteInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: dendrite temporary directory leaked: /var/tmp/omicron_tmp/.tmpiFAjac WARN: dropped MgdInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: mgd temporary directory leaked: /var/tmp/omicron_tmp/.tmpONR12y WARN: dropped MgdInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: mgd temporary directory leaked: /var/tmp/omicron_tmp/.tmpFAqwzC running 1 test running commands with args: ["db", "db-metadata", "ls-nexus"] running commands with args: ["--destructive", "db", "db-metadata", "force-mark-nexus-quiesced", "--skip-confirmation", "913233fe-92a8-4635-9572-183f495429c4"] running commands with args: ["db", "disks", "list"] running commands with args: ["db", "dns", "show"] running commands with args: ["db", "dns", "diff", "external", "2"] running commands with args: ["db", "dns", "names", "external", "2"] running commands with args: ["db", "instances"] running commands with args: ["db", "sleds"] running commands with args: ["db", "sleds", "-F", "discretionary"] running commands with args: ["mgs", "inventory"] running commands with args: ["nexus", "background-tasks", "doc"] running commands with args: ["nexus", "background-tasks", "show", "--no-executing-info"] running commands with args: ["nexus", "background-tasks", "show", "saga_recovery", "--no-executing-info"] running commands with args: ["nexus", "background-tasks", "show", "blueprint_loader", "blueprint_executor", "--no-executing-info"] running commands with args: ["nexus", "background-tasks", "show", "dns_internal", "--no-executing-info"] running commands with args: ["nexus", "background-tasks", "show", "dns_external", "--no-executing-info"] running commands with args: ["nexus", "background-tasks", "show", "all", "--no-executing-info"] running commands with args: ["nexus", "sagas", "list"] running commands with args: ["--destructive", "nexus", "sagas", "demo-create"] running commands with args: ["nexus", "sagas", "list"] running commands with args: ["--destructive", "nexus", "background-tasks", "activate", "inventory_collection"] running commands with args: ["nexus", "blueprints", "list"] running commands with args: ["nexus", "blueprints", "show", "505d2f54-2c59-48d6-9cde-099d7fea7022"] running commands with args: ["nexus", "blueprints", "show", "current-target"] running commands with args: ["nexus", "blueprints", "diff", "505d2f54-2c59-48d6-9cde-099d7fea7022", "current-target"] running commands with args: ["nexus", "blueprints", "diff", "505d2f54-2c59-48d6-9cde-099d7fea7022"] running commands with args: ["nexus", "reconfigurator-config", "show", "current"] running commands with args: ["nexus", "update-status"] running commands with args: ["nexus", "update-status", "--details"] running commands with args: ["-w", "nexus", "reconfigurator-config", "set", "--planner-enabled", "true"] running commands with args: ["-w", "nexus", "reconfigurator-config", "set", "--add-zones-with-mupdate-override", "true"] running commands with args: ["nexus", "reconfigurator-config", "show", "current"] running commands with args: ["reconfigurator", "export", "/var/tmp/omicron_tmp/.tmpTKL4lJ/reconfigurator-export.out"] running commands with args: ["db", "whatis", "001de000-5110-4000-8000-000000000000", "001de000-05e4-4000-8000-000000004007"] running commands with args: ["--destructive", "db", "db-metadata", "force-mark-nexus-quiesced", "--skip-confirmation", "--skip-blueprint-validation", "913233fe-92a8-4635-9572-183f495429c4"] @@ -2134,10 +2134,11 @@ stdout: Reconfigurator config: version: 1 modified time: <REDACTED_TIMESTAMP> tuf repo pruner enabled: true + disruption policy: terminate planner enabled: false planner config: add zones with mupdate override: false --------------------------------------------- stderr: @@ -2216,10 +2217,11 @@ --------------------------------------------- stdout: reconfigurator config updated to version 2: tuf repo pruner enabled: true (unchanged) * planner enabled::::::::: false -> true + disruption policy::::::: terminate (unchanged) planner config: add zones with mupdate override: false (unchanged) --------------------------------------------- stderr: note: using Nexus URL http://127.0.0.1:REDACTED_PORT/ @@ -2229,10 +2231,11 @@ --------------------------------------------- stdout: reconfigurator config updated to version 3: tuf repo pruner enabled: true (unchanged) planner enabled::::::::: true (unchanged) + disruption policy::::::: terminate (unchanged) planner config: * add zones with mupdate override: false -> true --------------------------------------------- stderr: note: using Nexus URL http://127.0.0.1:REDACTED_PORT/ @@ -2243,10 +2246,11 @@ stdout: Reconfigurator config: version: 3 modified time: <REDACTED_TIMESTAMP> tuf repo pruner enabled: true + disruption policy: terminate planner enabled: true planner config: add zones with mupdate override: true --------------------------------------------- stderr: test test_omdb_success_cases ... FAILED failures: failures: test_omdb_success_cases test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 2 filtered out; finished in 22.31s log file: /var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.363263.0.log note: configured to log to "/var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.363263.0.log" DB URL: postgresql://root@[::1]:34825/omicron?sslmode=disable DB address: [::1]:34825 log file: /var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.363263.2.log note: configured to log to "/var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.363263.2.log" log file: /var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.363263.3.log note: configured to log to "/var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.363263.3.log" thread 'test_omdb_success_cases' (363264) panicked at dev-tools/omdb/tests/test_all_output.rs:407:5: assertion failed: string doesn't match the contents of file: "tests/successes.out" see diffset above set EXPECTORATE=overwrite if these changes are intentional stack backtrace: 0: __rustc::rust_begin_unwind at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/std/src/panicking.rs:689:5 1: core::panicking::panic_fmt at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/panicking.rs:80:14 2: expectorate::assert_contents::<&str> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/expectorate-1.2.0/src/lib.rs:67:9 3: {async_block#0} at ./tests/test_all_output.rs:407:5 4: poll<&mut dyn core::future::future::Future<Output=()>> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/future/future.rs:133:9 5: poll<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/future/future.rs:133:9 6: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:778:70 7: with_budget<core::task::poll::Poll<()>, tokio::runtime::scheduler::current_thread::{impl#9}::block_on::{closure#0}::{closure#0}::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/task/coop/mod.rs:167:5 8: budget<core::task::poll::Poll<()>, tokio::runtime::scheduler::current_thread::{impl#9}::block_on::{closure#0}::{closure#0}::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/task/coop/mod.rs:133:5 9: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:778:25 10: <tokio::runtime::scheduler::current_thread::Context>::enter::<core::task::poll::Poll<()>, <tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}::{closure#0}> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:451:19 11: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:777:44 12: <tokio::runtime::scheduler::current_thread::CoreGuard>::enter::<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0} at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:865:68 13: <tokio::runtime::context::scoped::Scoped<tokio::runtime::scheduler::Context>>::set::<<tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>)> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context/scoped.rs:40:9 14: tokio::runtime::context::set_scheduler::<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>), <tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}>::{closure#0} at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context.rs:181:38 15: try_with<tokio::runtime::context::Context, tokio::runtime::context::set_scheduler::{closure_env#0}<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>), tokio::runtime::scheduler::current_thread::{impl#9}::enter::{closure_env#0}<tokio::runtime::scheduler::current_thread::{impl#9}::block_on::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>, core::option::Option<()>>>, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>)> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/std/src/thread/local.rs:513:12 16: <std::thread::local::LocalKey<tokio::runtime::context::Context>>::with::<tokio::runtime::context::set_scheduler<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>), <tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}>::{closure#0}, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>)> at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/std/src/thread/local.rs:477:20 17: tokio::runtime::context::set_scheduler::<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core>, core::option::Option<()>), <tokio::runtime::scheduler::current_thread::CoreGuard>::enter<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>>::{closure#0}> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context.rs:181:17 18: <tokio::runtime::scheduler::current_thread::CoreGuard>::enter::<<tokio::runtime::scheduler::current_thread::CoreGuard>::block_on<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>>::{closure#0}, core::option::Option<()>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:865:27 19: <tokio::runtime::scheduler::current_thread::CoreGuard>::block_on::<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:765:24 20: {closure#0}<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:205:33 21: tokio::runtime::context::runtime::enter_runtime::<<tokio::runtime::scheduler::current_thread::CurrentThread>::block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>>::{closure#0}, ()> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/context/runtime.rs:65:16 22: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/scheduler/current_thread/mod.rs:193:9 23: <tokio::runtime::runtime::Runtime>::block_on_inner::<core::pin::Pin<&mut dyn core::future::future::Future<Output = ()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/runtime.rs:371:52 24: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>> at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.52.1/src/runtime/runtime.rs:345:18 25: test_omdb_success_cases at ./tests/test_all_output.rs:461:31 26: test_all_output::test_omdb_success_cases::{closure#0} at ./tests/test_all_output.rs:135:35 27: <test_all_output::test_omdb_success_cases::{closure#0} as core::ops::function::FnOnce<()>>::call_once at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/ops/function.rs:250:5 28: core::ops::function::FnOnce::call_once at /rustc/4a4ef493e3a1488c6e321570238084b38948f6db/library/core/src/ops/function.rs:250:5 note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace. WARN: dropped CockroachInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: temporary directory leaked: "/var/tmp/omicron_tmp/.tmpK5xbae" If you would like to access the database for debugging, run the following: # Run the database cargo xtask db-dev run --no-populate --store-dir "/var/tmp/omicron_tmp/.tmpK5xbae/data" # Access the database. Note the port may change if you run multiple databases. cockroach sql --host=localhost:32221 --insecure WARN: dropped ClickHouse process without cleaning it up first (there may still be a child process running (PID 363868) and a temporary directory leaked, /var/tmp/omicron_tmp/test_all_output-c4abc73da5e8bda2-test_omdb_success_cases.363263.1-clickhouse-6EhQMo) WARN: dropped DendriteInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: dendrite temporary directory leaked: /var/tmp/omicron_tmp/.tmpI3RuoG WARN: dropped DendriteInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: dendrite temporary directory leaked: /var/tmp/omicron_tmp/.tmpE5kEJe WARN: dropped MgdInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: mgd temporary directory leaked: /var/tmp/omicron_tmp/.tmpM7ZgUw WARN: dropped MgdInstance without cleaning it up first (there may still be a child process running and a temporary directory leaked) WARN: mgd temporary directory leaked: /var/tmp/omicron_tmp/.tmp2HZakW