1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145
|
# Tests that are equally flaky on other bots (either globally, or on Linux bots),
# which we want to skip to reduce noise from failures not related to accessibility.
# Periodically check to see if they are still flaky via the links provided.
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FAdsPageLoadMetricsObserverResourceBrowserTest.ReceivedPrivacyPermissionsUseCounters%2FAll.ReduceTransferSizeUpdatedIPCDisabled
-All/AdsPageLoadMetricsObserverResourceBrowserTest.ReceivedPrivacyPermissionsUseCounters/ReduceTransferSizeUpdatedIPCDisabled
# Flaky on Linux: https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FCookieSettingsTest.BasicCookies%2FAll.4
-All/CookieSettingsTest.BasicCookies/4
# Flaky on Linux: https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FCookieSettingsTest.BasicCookiesHttps%2FAll.5
-All/CookieSettingsTest.BasicCookiesHttps/5
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FOmniboxSearchAggregatorHTTPErrorTest.HTTPErrorResponse%2FAll.403
-All/OmniboxSearchAggregatorHTTPErrorTest.HTTPErrorResponse/403
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FOmniboxSearchAggregatorHTTPErrorTest.HTTPErrorResponse%2FAll.405
-All/OmniboxSearchAggregatorHTTPErrorTest.HTTPErrorResponse/405
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FOmniboxSearchAggregatorHTTPErrorTest.HTTPErrorResponse%2FAll.502
-All/OmniboxSearchAggregatorHTTPErrorTest.HTTPErrorResponse/502
# Flaky on Linux: https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FPdfDownloadTestSplitCacheEnabled.OpenDownloadInMostRecentBrowser%2FAll.PdfOopifEnabled_TriplePlusCrossSiteMainFrameNavigationBool
-All/PdfDownloadTestSplitCacheEnabled.OpenDownloadInMostRecentBrowser/PdfOopifEnabled_TriplePlusCrossSiteMainFrameNavigationBool
# Flaky on Windows, occasionally on Linux: https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FSearchEnginePreconnectorEnabledOnlyBrowserTest.AllowedSearch%2FAll.1
-All/SearchEnginePreconnectorEnabledOnlyBrowserTest.AllowedSearch/1
# Occasionally flaky on Linux: https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FSearchEnginePreconnectorWithPreconnect2FeatureBrowserTest.PreconnectSearchAfterOnFailure%2FAll.0
-All/SearchEnginePreconnectorWithPreconnect2FeatureBrowserTest.PreconnectSearchAfterOnFailure/0
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FAutocompleteTest.SubmitSimpleValue_OTR_DoesNotSave
-AutocompleteTest.SubmitSimpleValue_OTR_DoesNotSave
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FBookmarksTest.List
-BookmarksTest.List
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FBookmarksTest.List___bookmarks_list__resets_focused_index_if_out_of_bounds
-BookmarksTest.List___bookmarks_list__resets_focused_index_if_out_of_bounds
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FBrowserNavigatorTest.SaveAfterFocusTabSwitchTest
-BrowserNavigatorTest.SaveAfterFocusTabSwitchTest
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FClickToCallBrowserTest.ContextMenu_TelLink_Histograms
-ClickToCallBrowserTest.ContextMenu_TelLink_Histograms
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FCrComponentsSearchboxTest.RealboxTest
-CrComponentsSearchboxTest.RealboxTest
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FCrComponentsSearchboxTest.RealboxTest__NewTabPageRealboxTest_arrow_up_down_moves_selection___focus
-CrComponentsSearchboxTest.RealboxTest__NewTabPageRealboxTest_arrow_up_down_moves_selection___focus
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FCrElementsTest.CrToast
-CrElementsTest.CrToast
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FCrElementsTest.CrToast__cr_toast_stop_and_restart_auto_hide_depending_when_toast_focus_changes
-CrElementsTest.CrToast__cr_toast_stop_and_restart_auto_hide_depending_when_toast_focus_changes
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FDocumentPictureInPictureWindowControllerBrowserTest.CreateTwice
-DocumentPictureInPictureWindowControllerBrowserTest.CreateTwice
# Flaky on Linux: https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FDownloadToolbarUIControllerBrowserTest.DialogAutoCloses
-DownloadToolbarUIControllerBrowserTest.DialogAutoCloses
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FDownloadToolbarUIControllerBrowserTest.OpenPrimaryDialog
-DownloadToolbarUIControllerBrowserTest.OpenPrimaryDialog
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FFlagsUiBrowserTest.App
-FlagsUiBrowserTest.App
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FHistoryProductSpecificationsListTest.Load
-HistoryProductSpecificationsListTest.Load
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FHistoryProductSpecificationsListTest.Load__ProductSpecificationsListTest_focus_with_arrow_keys
-HistoryProductSpecificationsListTest.Load__ProductSpecificationsListTest_focus_with_arrow_keys
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FInlineLoginHelperBrowserTest.UntrustedSigninDialogCancel
-InlineLoginHelperBrowserTest.UntrustedSigninDialogCancel
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FLensOverlayControllerContextualFeaturesDisabledTest.PreselectionToastOmniboxFocusState
-LensOverlayControllerContextualFeaturesDisabledTest.PreselectionToastOmniboxFocusState
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FPolicyTest.DefaultCookiesSetting
-PolicyTest.DefaultCookiesSetting
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FPopupTrackerBrowserTest.PopupRedirectsTwice_RedirectCountTwo
-PopupTrackerBrowserTest.PopupRedirectsTwice_RedirectCountTwo
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FPreviewBrowserTest.ErrorOnRedirectionToNonHttpsUrl
-PreviewBrowserTest.ErrorOnRedirectionToNonHttpsUrl
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FPreviewBrowserTest.MojoCapabilityControl
-PreviewBrowserTest.MojoCapabilityControl
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FPreviewBrowserTest.TrivialSessionHistory
-PreviewBrowserTest.TrivialSessionHistory
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FPreviewBrowserTest.ErrorOnNonHttpsUrl
-PreviewBrowserTest.ErrorOnNonHttpsUrl
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FPreviewPageLoadMetricsObserverBrowserTest.LinkPreviewUsageUsedButNotPromoted
-PreviewPageLoadMetricsObserverBrowserTest.LinkPreviewUsageUsedButNotPromoted
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FPreviewPageLoadMetricsObserverBrowserTest.PreviewFinalStatus
-PreviewPageLoadMetricsObserverBrowserTest.PreviewFinalStatus
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FProductSpecificationsTest.ComparisonTableListItem
-ProductSpecificationsTest.ComparisonTableListItem
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FProductSpecificationsTest.ComparisonTableListItem__ComparisonTableListItemTest_context_menu_rename_option_displays_input__and_submitting_emits_event_with_UUID_and_name
-ProductSpecificationsTest.ComparisonTableListItem__ComparisonTableListItemTest_context_menu_rename_option_displays_input__and_submitting_emits_event_with_UUID_and_name
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FProductSpecificationsTest.Header
-ProductSpecificationsTest.Header
# Flaky on Linux: https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FProductSpecificationsTest.Header
-ProfileMenuViewPixelTest.InvokeUi_default/SignedOut_MultipleProfiles_DarkTheme
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FRecentActivityBubbleDialogViewActionBrowserTest.HandlesActionFocusTab
-RecentActivityBubbleDialogViewActionBrowserTest.HandlesActionFocusTab
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FRecentActivityBubbleDialogViewActionBrowserTest.HandlesActionOpenTabGroupEditDialog
-RecentActivityBubbleDialogViewActionBrowserTest.HandlesActionOpenTabGroupEditDialog
# Flaky on Linux: https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FSaveCardBubbleViewsFullFormBrowserTest.Local_ClickingNoThanksClosesBubble
-SaveCardBubbleViewsFullFormBrowserTest.Local_ClickingNoThanksClosesBubble
# Flaky on Linux: https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FSaveCardBubbleViewsFullFormBrowserTest.Local_ClickingSave_ClosesBubble
-SaveCardBubbleViewsFullFormBrowserTest.Local_ClickingSave_ClosesBubble
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FDocumentPictureInPictureWindowControllerBrowserTest.CreateTwice
-SaveCardBubbleViewsFullFormBrowserTest.Local_ManageCardsDoneButtonClosesBubble
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FSearchPrefetchServiceEnabledBrowserTest.HungRequestCanBeServed
-SearchPrefetchServiceEnabledBrowserTest.HungRequestCanBeServed
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FSettingsTest.PaymentsSectionCardDialogs
-SettingsTest.PaymentsSectionCardDialogs
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FSettingsTest.PaymentsSectionCardDialogs__PaymentsSectionCardDialogs_verifyOnlyValidCardNumbersAllowed_InvalidCasesWithNoError
-SettingsTest.PaymentsSectionCardDialogs__PaymentsSectionCardDialogs_verifyOnlyValidCardNumbersAllowed_InvalidCasesWithNoError
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FSettingsTest.PaymentsSectionIban
-SettingsTest.PaymentsSectionIban
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FSettingsTest.PaymentsSectionIban__PaymentsSectionIban_verifyIBANErrorMessage
-SettingsTest.PaymentsSectionIban__PaymentsSectionIban_verifyIBANErrorMessage
# Flaky on Linux: https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FSystemNetworkContextManagerWithFirstPartySetComponentBrowserTest.ReloadsFirstPartySetsAfterCrash
-SystemNetworkContextManagerWithFirstPartySetComponentBrowserTest.ReloadsFirstPartySetsAfterCrash
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FTabStripBrowsertest.TabGroupTabNavigationAccelerators
-TabStripBrowsertest.TabGroupTabNavigationAccelerators
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FTabRestoreTest.RestoreGroupWithUnloadHandlerRejected
-TabRestoreTest.RestoreGroupWithUnloadHandlerRejected
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FWebAuthenticationProxyApiTest.RemoteSessionStateChange
-WebAuthenticationProxyApiTest.RemoteSessionStateChange
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FWebBluetoothTest.NavigateWithChooserCrossOrigin
-WebBluetoothTest.NavigateWithChooserCrossOrigin
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FWebUIWebViewCoverageDisabledBrowserTest.AddContentScriptsWithNewWindowAPI
-WebUIWebViewCoverageDisabledBrowserTest.AddContentScriptsWithNewWindowAPI
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FWebViewUsbTest.Shim_TestCannotRequestUsb%2FMPArch
-WebViewUsbTest.Shim_TestCannotRequestUsb/MPArch
# https://ci.chromium.org/ui/test/chromium/ninja%3A%2F%2Fchrome%2Ftest%3Abrowser_tests%2FWebViewTest.Shim_TestTerminateAfterExit%2FInnerWebContents
-WebViewTest.Shim_TestTerminateAfterExit/InnerWebContents
# These tests are run on the main builders and don't need to also be run here.
-AccessibilityLabelsMenuObserverTest.*
-All/DumpAccessibility*
-AutomationApiTest.*
# These tests require that accessibility is disabled at startup, or that there
# is some other AXMode during the test, which will not be the case when
# --force-renderer-accessibility is used.
-AccessibilityLabelsBrowserTest.NotEnabledWithoutScreenReader
-All/PdfOcrControllerBrowserTest.NotEnabledWithoutScreenReader/0
-AXMainNodeAnnotatorControllerBrowserTest.NotEnabledWithoutScreenReader
-PersistentBackground/AutomationApiTestWithContextType.ImageLabels/0
-PersistentBackground/AutomationApiTestWithContextType.TestRendererAccessibilityEnabled/0
-ServiceWorker/AutomationApiTestWithContextType.ImageLabels/0
-ServiceWorker/AutomationApiTestWithContextType.TestRendererAccessibilityEnabled/0
# The contents of chrome://prefs-interals for these tests is huge, with over
# 46K FragmentItems being processed in AXBlockFlowData::ProcessLayoutBlock().
# Processing lots of fragments, even when each one doesn't have a huge number
# of items, also seems problematic. See crbug.com/417174864.
-ChromeURLDataManagerWebUITrustedTypesTest.NoTrustedTypesViolation/chrome___prefs_internals
-HistogramsInternalsUIBrowserTest.*
-PrefsInternalsTest.TestPrefsAreServed
# To triage: These tests are confirmed to be flaky or fail, but mainly on "heavy"
# bots, e.g. debug, *san, etc; not just accessibility.
-All/PdfDownloadTestSplitCacheEnabled.OpenDownloadInMostRecentBrowser/PdfOopifDisabled_TriplePlusCrossSiteMainFrameNavigationBool
-ClickToCallBrowserTest.ContextMenu_NoDevicesAvailable
-WebAppEngagementBrowserTest.CommandLineWindowByAppId
|