Flaky Tests

[!NOTE] This issue is automatically updated every day and provides an overview of flaky tests that have appeared in CI over the past 30 days.

Candidates are chosen by selecting CI workflow runs that failed and succeeded after being re-triggered (no pushes can occur inbetween, as that would create an entirely new run). While this approach minimizes false positives, note that many failed runs are not manually retriggered and thus not taken into consideration. As a result, the number of failed runs below is almost guaranteed to be lower than the number of failures technically observable.

We highly appreciate all help in fixing flaky tests! Once a fix has been merged, the test should eventually fade out of the below list within 30 days at most.

---

TestKVPatchCommand_403Fallback

Package: command Last seen: 03/03/2026

<details><summary>View 7 failed jobs</summary>

| Date | Job ID | Link | |------|--------|------| | 03/03/2026 | 65536864561 | Click here | | 03/03/2026 | 65533735427 | Click here | | 03/03/2026 | 65529785705 | Click here | | 23/02/2026 | 64556479393 | Click here | | 16/02/2026 | 63695455796 | Click here | | 11/02/2026 | 63281381164 | Click here | | 09/02/2026 | 62915882736 | Click here |

</details>

TestSSHBackend_BasicIssuerOperations

Package: builtin/logical/ssh Last seen: 27/02/2026

<details><summary>View 3 failed jobs</summary>

| Date | Job ID | Link | |------|--------|------| | 27/02/2026 | 65150943703 | Click here | | 16/02/2026 | 63723778064 | Click here | | 16/02/2026 | 63695501085 | Click here |

</details>

TestAgent_Template_Basic

Package: command Last seen: 02/03/2026

<details><summary>View 3 failed jobs</summary>

| Date | Job ID | Link | |------|--------|------| | 02/03/2026 | 65370183695 | Click here | | 02/03/2026 | 65335465963 | Click here | | 06/02/2026 | 62725305867 | Click here |

</details>

TestSealMigration_TransitToShamir_Post14

Package: vault/external_tests/sealmigration Last seen: 03/03/2026

<details><summary>View 3 failed jobs</summary>

| Date | Job ID | Link | |------|--------|------| | 03/03/2026 | 65529778091 | Click here | | 12/02/2026 | 63396438797 | Click here | | 11/02/2026 | 63248603855 | Click here |

</details>

TestJWTEndToEnd

Package: command/agent Last seen: 02/03/2026

<details><summary>View 2 failed jobs</summary>

| Date | Job ID | Link | |------|--------|------| | 02/03/2026 | 65368651803 | Click here | | 16/02/2026 | 63695497252 | Click here |

</details>

TestSealMigration_ShamirToTransit_Post14

Package: vault/external_tests/sealmigration Last seen: 04/03/2026

<details><summary>View 2 failed jobs</summary>

| Date | Job ID | Link | |------|--------|------| | 04/03/2026 | 65742635597 | Click here | | 09/02/2026 | 62915831459 | Click here |

</details>

TestBackend_StaticRole_LockRegression

Package: builtin/logical/database Last seen: 16/02/2026

<details><summary>View 1 failed job</summary>

| Date | Job ID | Link | |------|--------|------| | 16/02/2026 | 63723788265 | Click here |

</details>

TestBackend_Static_QueueWAL_discard_role_newer_rotation_date

Package: builtin/logical/database Last seen: 10/02/2026

<details><summary>View 1 failed job</summary>

| Date | Job ID | Link | |------|--------|------| | 10/02/2026 | 63086840276 | Click here |

</details>

Test_ACME

Package: builtin/logical/pkiext/pkiext_binary Last seen: 04/03/2026

<details><summary>View 1 failed job</summary>

| Date | Job ID | Link | |------|--------|------| | 04/03/2026 | 65691791065 | Click here |

</details>

TestAuditEnableCommand_Run

Package: command Last seen: 03/03/2026

<details><summary>View 1 failed job</summary>

| Date | Job ID | Link | |------|--------|------| | 03/03/2026 | 65529778058 | Click here |

</details>

TestKVPatchCommand_StdinValue

Package: command Last seen: 23/02/2026

<details><summary>View 1 failed job</summary>

| Date | Job ID | Link | |------|--------|------| | 23/02/2026 | 64472697358 | Click here |

</details>

TestExecServer_Run

Package: command/agent/exec Last seen: 12/02/2026

<details><summary>View 1 failed job</summary>

| Date | Job ID | Link | |------|--------|------| | 12/02/2026 | 63396438840 | Click here |

</details>

TestExternalPlugin_AuthMethod

Package: vault/external_tests/plugin Last seen: 03/02/2026

<details><summary>View 1 failed job</summary>

| Date | Job ID | Link | |------|--------|------| | 03/02/2026 | 62355041809 | Click here |

</details>

TestRaft_NodeIDHeader

Package: vault/external_tests/raft Last seen: 04/03/2026

<details><summary>View 1 failed job</summary>

| Date | Job ID | Link | |------|--------|------| | 04/03/2026 | 65683686241 | Click here |

</details>

TestRaft_SnapshotAPI_DifferentCluster

Package: vault/external_tests/raft Last seen: 04/03/2026

<details><summary>View 1 failed job</summary>

| Date | Job ID | Link | |------|--------|------| | 04/03/2026 | 65683686241 | Click here |

</details>