Skip to content

Fix temporary disabled tests #3211

Open
0 of 1 issue completed
Open

Description

@DenBond7

A. Active tests (not disabled) — main list

  • ComposeScreenFlowTest#testEmptyEmailMsg — 6 / 5 / 3 / 2026-10-22. Semaphore pass rate 57%. Fixed in Fix flaky instrumentation tests on slow CI emulators (part of #3211) #3340
  • ComposeScreenFlowTest#testSharePubKeyMultiply — 5 / 5 / 2 / 2026-10-21. Semaphore pass rate 50%. Fixed in Fix flaky instrumentation tests on slow CI emulators (part of #3211) #3340
  • CreateMessageFragmentDisallowAttesterSearchForDomainInIsolationTest#testCanLookupThisRecipientOnAttester — 6 / 5 / 2 / 2026-10-16. Fixed in Issue 3211 fix flaky tests part 2 #3347
  • MessagesListFragmentInIsolationTest#testBaseInfo — 6 / 6 / 2 / 2025-11-24. @DependsOnMailServer
  • PrivateKeyDetailsFragmentPassInRamFlexibleTimeFlowTest#testInMemoryPassPhraseSessionLengthParameter — 2 / 2 / 2 / 2026-10-20. Semaphore pass rate 60%. Fixed in Issue 3211 fix flaky tests part 2 #3347
  • StandardWithPublicKeyComposeGmailApiFlow#testSending — 2 / 2 / 2 / 2026-10-15. Fixed in Fix flaky instrumentation tests on slow CI emulators (part of #3211) #3340
  • FesDuringSetupEnterpriseFlowTest — testFesAvailableSuccess, testFesAvailableHasConnectionHttpCode404, testFesAvailableHasConnectionHttpCodeNot200, testFesAvailableRequestTimeOutHasConnection, testFesAvailableWrongServiceName — ~10 / 5 / 0 / 2026-05-11. These fail together, probably a shared setup issue
  • ComposeScreenPasswordProtectedDisallowedTermsNullFlowTest#testMissingOptionalPropertiesInClientConfiguration — 4 / 4 / 0 / 2026-10-15. Fixed in Fix flaky instrumentation tests on slow CI emulators (part of #3211) #3340
  • ComposeScreenFlowTest#testSelectedRemoveRecipientFromPopUp — 4 / 4 / 0 / 2026-10-04. Fixed in Issue 3211 fix flaky tests part 2 #3347
  • SignInScreenFlowTest#testUseGmail — 4 / 2 / 0 / 2026-10-15
  • CheckKeysFragmentSinglePartiallyEncryptedKeyTest#testShowingDialog — 3 / 2 / 1 / 2026-10-11
  • CreateMessageFragmentInIsolationTest#testAddingRecipientWithUsablePubKey — 3 / 3 / 1 / 2026-08-16
  • CreateMessageFragmentInIsolationTest#testUpdatingAddRecipientLabel — 3 / 2 / 0 / 2026-03-21
  • DraftsGmailAPITestCorrectCreatingAndUpdatingFlowTest#testCorrectCreatingAndUpdating — 2 / 2 / 1 / 2026-10-18
  • SelectRecipientsFragmentFlowTest#testSearchExistingContact — 5 / 2 / 0 / 2026-07-01
  • SelectRecipientsFragmentFlowTest#testNoResults — 3 / 2 / 0 / 2026-07-01
  • ComposeScreenPasswordProtectedDisallowedTermsFlowTest#testDialogWithoutErrorText — 2 / 2 / 0 / 2026-05-22. Fixed in Fix flaky instrumentation tests on slow CI emulators (part of #3211) #3340
  • ThreadDetailsSwipeToRefreshGmailApiFlowTest#testUpdatingThreadAfterSwipeToRefresh — 2 / 2 / 0 / 2026-10-11. Also on Semaphore's flaky list
  • ComposeScreenExternalIntentsFlowTest#testMultiToParamSubjectBody — 2 / 2 / 0 / 2026-10-22. Semaphore also lists 5 more tests of this class (2026-10-22)
  • ThreadDetailsGmailApiFlowTest#testThreadDetailsWithFewEncryptedMessages — 1 / 1 / 0 / 2026-10-11. On Semaphore's flaky list
  • ThreadDetailsGmailApiFlowTest#testThreadDetailsFewMessagesAndSingleDraft — 1 / 1 / 1 / 2026-10-16. On Semaphore's flaky list

Weaker signal: each of these failed only once, but the same commit passed in another run.

  • AddNewAccountEnterpriseFlowTest#testNoPrvCreateRule
  • ImportRecipientsFromSourceFragmentFlowTest#testImportKeyFromFile
  • CheckCredentialsFragmentInIsolationTest#testAuthorizationSuccess
  • ComposeScreenPasswordProtectedDisallowedTermsErrorTextMissingFlowTest#testMissingOptionalPropertiesInClientConfiguration. Fixed in Fix flaky instrumentation tests on slow CI emulators (part of #3211) #3340 (shared base class changes)
  • BackupKeysFragmentSingleKeyPassphraseInRamFlowTest#testNeedPassphraseDownloadOptionSingleFingerprint
  • AuthorizeAndSearchBackupsFragmentInIsolationTest#testReturnExceptionForFailedAuthorization

B. Marked with @FlakyTest but still failing

  • MessagesListChangeGmailLabelsFlowTest#testLabelsManagement: 3 fails, 3 branches, last fail 2026-10-23
  • DraftsGmailAPITestCorrectSendingFlowTest#testCorrectDraftsSending: 4 fails, 4 branches, last fail 2026-10-22. Fixed in Fix flaky instrumentation tests on slow CI emulators (part of #3211) #3340
  • StandardReplyComposeGmailApiFlow#testSending: on Semaphore's flaky list, last fail 2026-10-20

C. Disabled with @Ignore as flaky — need fixing and re-enabling

CI history confirms these are flaky:

  • ComposeScreenPasswordProtectedDisallowedTermsReFetchConfigurationFlowTest (whole class): 22 fails, 10 branches. The worst case. Fixed and re-enabled in Fix flaky instrumentation tests on slow CI emulators (part of #3211) #3340
  • AttachmentDownloadingWithRestrictionFlowTest#testDownloadingAttachment: 21 fails, 14 branches
  • WkdClientTest#existingEmailFlowCryptDomainTest: 5 fails, 4 branches. Fixed and re-enabled in Fix flaky instrumentation tests on slow CI emulators (part of #3211) #3340
  • CheckCredentialsFragmentInIsolationTest#testReturnExceptionForFailedAuthorization: 4 fails, 4 branches
  • SubmitPublicKeyAfterCreationNonGoogleAccountFlowTest (whole class): 5 fails, 4 branches
  • ComposeScreenFlowTest#testSelectImportPublicKeyFromPopUp: 5 fails, 4 branches. Fixed and re-enabled in Issue 3211 fix flaky tests part 2 #3347
  • ComposeScreenFlowTest#testEmptyEmailSubject: 2 fails, 2 branches. Fixed and re-enabled in Issue 3211 fix flaky tests part 2 #3347
  • MessageDetailsChangeGmailLabelsFlowTest#testLabelsManagement: 2 fails, 2 branches
  • CreateMessageFragmentDisallowAttesterSearchInIsolationTest#testDisallowLookupOnAttester: 4 fails, 3 branches. Fixed and re-enabled in Issue 3211 fix flaky tests part 2 #3347
  • ComposeScreenNewMessageWithGmailApiSignatureFlowTest#testAddingSignatureAfterStart: 3 fails, 3 branches
  • AddOtherAccountFlowTest#testShowWarningIfAuthFail: 3 fails, 3 branches
  • StandardForwardOfEncryptedPgpMimeMessageWithOriginalAttachmentsComposeGmailApiFlow#testSending: 3 fails, 2 branches
  • ImportRecipientAllowAttesterSearchOnlyForDomainsFlowTest#testAllowAttesterSearchOnlyForDomains: 2 fails, 2 branches

Disabled as flaky, with no failures in the available CI history:

  • ComposeScreenForwardWithGmailApiSignatureFlowTest#testAddingSignatureAfterStart
  • ComposeScreenReplyWithGmailApiSignatureFlowTest#testAddingSignatureAfterStart
  • MessageDetailsFlowTest#testFwdButton
  • MessageDetailsFlowTest#testSignedMsgClearSign
  • MessageDetailsFlowTest#testSignatureVerificationCleartextOnlySignedPartially
  • MessageDetailsFlowTest#testSignatureVerificationDetachedSignatureContentAndPublicKey
  • MessageDetailsFlowTest#testSignatureVerificationInbandEncryptedSignedPartially
  • MessageDetailsFlowTest#testSignatureVerificationInbandOnlyEncrypted
  • MessageDetailsFlowTest#testSignatureVerificationInbandOnlySignedPartially
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

android_testingThis label means we need to add an Android test.

Type

No type

Projects

No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions