Many key new modules and test changes are introduced in Android 11 for CTS.
CTS Features
New and updated documentation for Android 11 CTS features is as follows.
| Feature | Description | Added/Updated |
|---|---|---|
| Automatic Test Retry | Tradefed auto-retry helps to reduce the impact of flakiness on the runs. | Updated |
| Automated log on failure collection | Auto-log collection helps get better logs for failures directly. | Updated |
| Command to allow access to non-SDK interfaces | Users should run CTS verifier new command adb shell settings put
global hidden_api_policy 1 before installing CTS Verifier
so it can access non-SDK interfaces |
Updated |
| CTS verifier new analog headset test | Added CTS Verifier test for analog headset jacks. Any Android-compatible analog headset works. | Updated |
| Command to install any required APK | Users can install any required APK with new
command adb install xxxx.apk. |
Updated |
| Command to save reports | Users should run CTS verifier new command
adb shell appops set com android.cts.verifier
MANAGE_EXTERNAL_STORAGE 0 command before saving reports. |
Updated |
A test for safe insets of DisplayCutout |
This test is to make sure that the area inside the safe insets
from the DisplayCutout should be fully visible and
touchable. |
Updated |
| CTS device interaction helper module | CTS device interaction helper module allows the customization of how CTS interacts with a limited set of replaced UI elements. | Updated |
| CTS test for APK fs-verity integration | CTS host-side test with a test helper app is added to enforce the new CDD requirement (C-0-3, C-0-4, and C-0-5). This feature is mandatory for new devices launched with Android 11 with kernel dependency. Similar to CtsShimPrebuilt, Google’s public key is checked in AOSP, and should be kept on release build. | Updated |
| CTS tests for APEX management APIs | Starting with Android 11, the
For more details, refer to CTS shim packages . |
Updated |
| CtsStatsdHostTestCases is tagged to be sim card required | CtsStatsdHostTestCase test module is tagged with the
SIM_CARD token, as UidAtomTests#testMobileBytesTransfer
requires regular SIM card with working data connection to be tested. |
Updated |
| CTS SIM test plan | A new cts-sim plan is available so that the subset of
tests can be run easily on a device with SIM card. Users need a
voice and data activated SIM to run these tests. |
Updated |
| Updated Wi-Fi RTT access point | New AP devices support the ResponderLocation feature. For more information, see Wi-Fi location with RTT. | Updated |
| OpenJDK 11 | Android 11 CTS should be run using the OpenJDK 11 toolchain. | Updated |
| Developer UICC specification for CTS testing | To run the CTS carrier API tests, the device needs to use a SIM card with carrier privileges. | Updated |
Added modules
Many key new modules and test changes are introduced in Android 11 for (Build date - 07/06/2020) CTS 11 R1 (Dev build 6656047) build vs. CTS 10_R5 and for platform build RP1A.200706.002.
A total of 225 modules are added.
| Test module name | ABI | |
|---|---|---|
cts-platform-version-check
|
arm64-v8a | |
cts-system-all.api[instant]
|
arm64-v8a | |
CtsAccessibilityServiceSdk29TestCases
|
arm64-v8a | |
CtsAccessibilityServiceSdk29TestCases[instant]
|
arm64-v8a | |
CtsAccountsHostTestCases
|
arm64-v8a | |
CtsAccountsHostTestCases[instant]
|
arm64-v8a | |
CtsAndroidTestBase28ApiSignatureTestCases[instant]
|
arm64-v8a | |
CtsAndroidTestBaseCurrentApiSignatureTestCases[instant]
|
arm64-v8a | |
CtsAndroidTestMockCurrentApiSignatureTestCases[instant]
|
arm64-v8a | |
CtsAndroidTestRunnerCurrentApiSignatureTestCases[instant]
|
arm64-v8a | |
CtsApacheHttpLegacy27ApiSignatureTestCases[instant]
|
arm64-v8a | |
CtsApacheHttpLegacyCurrentApiSignatureTestCases[instant]
|
arm64-v8a | |
CtsApacheHttpLegacyUsesLibraryApiSignatureTestCases[instant]
|
arm64-v8a | |
CtsAppCompatHostTestCases
|
arm64-v8a | |
CtsAppCompatHostTestCases[instant]
|
arm64-v8a | |
CtsAppEnumerationTestCases
|
arm64-v8a | |
CtsAppExitTestCases
|
arm64-v8a | |
CtsAppExitTestCases[instant]
|
arm64-v8a | |
CtsAppIntegrityDeviceTestCases
|
arm64-v8a | |
CtsBionicAppTestCases
|
arm64-v8a | |
CtsBionicAppTestCases[instant]
|
arm64-v8a | |
CtsBlobStoreHostTestCases
|
arm64-v8a | |
CtsBlobStoreHostTestHelper
|
arm64-v8a | |
CtsBlobStoreTestCases
|
arm64-v8a | |
CtsBlobStoreTestHelper
|
arm64-v8a | |
CtsBlobStoreTestHelperDiffSig
|
arm64-v8a | |
CtsBlobStoreTestHelperDiffSig2
|
arm64-v8a | |
CtsCalendarProviderTestCases
|
arm64-v8a | |
CtsCarHostTestCases
|
arm64-v8a | |
CtsCodePathHostTestCases
|
arm64-v8a | |
CtsContactsProviderTestCases
|
arm64-v8a | |
CtsControlsDeviceTestCases
|
arm64-v8a | |
CtsCurrentApiSignatureTestCases[instant]
|
arm64-v8a | |
CtsDownloadManagerInstaller
|
arm64-v8a | |
CtsDynamicMimeHostTestCases
|
arm64-v8a | |
CtsExtractNativeLibsHostTestCases
|
arm64-v8a | |
CtsFsMgrTestCases
|
arm64-v8a | |
CtsGpuProfilingDataTestCases
|
arm64-v8a | |
CtsGwpAsanTestCases
|
arm64-v8a | |
CtsGwpAsanTestCases[instant]
|
arm64-v8a | |
CtsHdmiCecHostTestCases
|
arm64-v8a | |
CtsHiddenApiBlacklistApi27TestCases[instant]
|
arm64-v8a | |
CtsHiddenApiBlacklistApi28TestCases[instant]
|
arm64-v8a | |
CtsHiddenApiBlacklistCurrentApiTestCases[instant]
|
arm64-v8a | |
CtsHiddenApiBlacklistDebugClassTestCases[instant]
|
arm64-v8a | |
CtsHiddenApiBlacklistTestApiTestCases
|
arm64-v8a | |
CtsHiddenApiBlacklistTestApiTestCases[instant]
|
arm64-v8a | |
CtsHiddenApiKillswitchDebugClassTestCases[instant]
|
arm64-v8a | |
CtsHiddenApiKillswitchWhitelistTestCases[instant]
|
arm64-v8a | |
CtsHiddenApiKillswitchWildcardTestCases[instant]
|
arm64-v8a | |
CtsIdentityTestCases
|
arm64-v8a | |
CtsIkeTestCases
|
arm64-v8a | |
CtsIncrementalInstallHostTestCases
|
arm64-v8a | |
CtsInitTestCases
|
arm64-v8a | |
CtsInstantAppTests
|
arm64-v8a | |
CtsJvmtiRunTest1962HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1967HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1968HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1969HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1970HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1971HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1974HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1975HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1976HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1977HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1978HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1979HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1981HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1982HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1983HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1984HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1988HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1989HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1990HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1991HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1992HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1994HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1995HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1996HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1997HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1998HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest1999HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest2001HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest2002HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest2003HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest2004HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest2005HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest2006HostTestCases
|
arm64-v8a | |
CtsJvmtiRunTest2007HostTestCases
|
arm64-v8a | |
CtsLocationCoarseTestCases
|
arm64-v8a | |
CtsLocationCoarseTestCases[instant]
|
arm64-v8a | |
CtsLocationFineTestCases
|
arm64-v8a | |
CtsLocationFineTestCases[instant]
|
arm64-v8a | |
CtsLocationGnssTestCases
|
arm64-v8a | |
CtsLocationGnssTestCases[instant]
|
arm64-v8a | |
CtsLocationNoneTestCases
|
arm64-v8a | |
CtsLocationNoneTestCases[instant]
|
arm64-v8a | |
CtsLocationPrivilegedTestCases
|
arm64-v8a | |
CtsLocationPrivilegedTestCases[instant]
|
arm64-v8a | |
CtsMatchFlagTestCases
|
arm64-v8a | |
CtsMediaParserTestCases
|
arm64-v8a | |
CtsMediaV2TestCases
|
arm64-v8a | |
CtsMimeMapTestCases
|
arm64-v8a | |
CtsNativeEncryptionTestCases
|
arm64-v8a | |
CtsNativeEncryptionTestCases[instant]
|
arm64-v8a | |
CtsNativeMediaMetricsTestCases
|
arm64-v8a | |
CtsNativeMediaMetricsTestCases[instant]
|
arm64-v8a | |
CtsNfcTestCases
|
arm64-v8a | |
CtsPackageInstallAppOpDefaultTestCases
|
arm64-v8a | |
CtsPackageInstallAppOpDefaultTestCases[instant]
|
arm64-v8a | |
CtsPackageInstallAppOpDeniedTestCases
|
arm64-v8a | |
CtsPackageInstallAppOpDeniedTestCases[instant]
|
arm64-v8a | |
CtsPackageWatchdogTestCases
|
arm64-v8a | |
CtsPermission3TestCases
|
arm64-v8a | |
CtsQuickAccessWalletTestCases
|
arm64-v8a | |
CtsQuickAccessWalletTestCases[instant]
|
arm64-v8a | |
CtsResourcesLoaderTests
|
arm64-v8a | |
CtsSdkExtensionsTestCases
|
arm64-v8a | |
CtsSdkExtensionsTestCases[instant]
|
arm64-v8a | |
CtsSecureFrpInstallTestCases
|
arm64-v8a | |
CtsSelinuxTargetSdk29TestCases
|
arm64-v8a | |
CtsSettingsHostTestCases
|
arm64-v8a | |
CtsSharedLibsApiSignatureTestCases[instant]
|
arm64-v8a | |
CtsSharesheetTestCases
|
arm64-v8a | |
CtsShortcutManagerLauncher1
|
arm64-v8a | |
CtsShortcutManagerLauncher2
|
arm64-v8a | |
CtsShortcutManagerLauncher3
|
arm64-v8a | |
CtsShortcutManagerLauncher4
|
arm64-v8a | |
CtsShortcutManagerPackage1
|
arm64-v8a | |
CtsShortcutManagerPackage2
|
arm64-v8a | |
CtsShortcutManagerPackage3
|
arm64-v8a | |
CtsShortcutManagerPackage4
|
arm64-v8a | |
CtsShortcutManagerThrottlingTest
|
arm64-v8a | |
CtsSoundTriggerTestCases
|
arm64-v8a | |
CtsSoundTriggerTestCases[instant]
|
arm64-v8a | |
CtsStrictJavaPackagesTestCases
|
arm64-v8a | |
CtsSuspendAppsPermissionTestCases
|
arm64-v8a | |
CtsSuspendAppsTestCases
|
arm64-v8a | |
CtsSystemApiAnnotationTestCases[instant]
|
arm64-v8a | |
CtsSystemApiSignatureTestCases[instant]
|
arm64-v8a | |
CtsTaggingHostTestCases
|
arm64-v8a | |
CtsTaggingHostTestCases[instant]
|
arm64-v8a | |
CtsTelephonyHostCases
|
arm64-v8a | |
CtsTelephonyProviderHostCases
|
arm64-v8a | |
CtsTelephonyTestCasesPermissionReadPhoneState
|
arm64-v8a | |
CtsTelephonyTestCasesPermissionReadPhoneState[instant]
|
arm64-v8a | |
CtsTetheringTest
|
arm64-v8a | |
CtsTextClassifierTestCases
|
arm64-v8a | |
CtsThermalTestCases
|
arm64-v8a | |
CtsUsbManagerTestCases
|
arm64-v8a | |
CtsUserspaceRebootHostSideTestCases
|
arm64-v8a | |
CtsWidgetTestCases29
|
arm64-v8a | |
CtsWidgetTestCases29[instant]
|
arm64-v8a | |
CtsWifiTestCases
|
arm64-v8a | |
CtsWifiTestCases[instant]
|
arm64-v8a | |
CtsWindowManagerJetpackTestCases
|
arm64-v8a | |
CtsWindowManagerSdk29TestCases
|
arm64-v8a | |
signed-CtsOmapiTestCases
|
arm64-v8a | |
signed-CtsOmapiTestCases[instant]
|
arm64-v8a | |
CtsScopedStorageHostTest
|
arm64-v8a | |
CtsScopedStorageHostTest[instant]
|
arm64-v8a | |
LegacyStorageTest
|
arm64-v8a | |
LegacyStorageTest[instant]
|
arm64-v8a | |
ScopedStorageTest
|
arm64-v8a | |
ScopedStorageTest[instant]
|
armeabi-v7a | |
CtsAdbHostTestCases
|
arm64-v8a | |
CtsCarTestCases[instant]
|
arm64-v8a | |
CtsAppOpsTestCases
|
armeabi-v7a | |
CtsBionicAppTestCases
|
armeabi-v7a | |
CtsCodePathHostTestCases
|
armeabi-v7a | |
CtsExtractNativeLibsHostTestCases
|
armeabi-v7a | |
CtsFsMgrTestCases
|
armeabi-v7a | |
CtsGpuProfilingDataTestCases
|
armeabi-v7a | |
CtsGwpAsanTestCases
|
armeabi-v7a | |
CtsIdentityTestCases
|
armeabi-v7a | |
CtsIncrementalInstallHostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1962HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1967HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1968HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1969HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1970HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1971HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1974HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1975HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1976HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1977HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1978HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1979HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1981HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1982HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1983HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1984HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1988HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1989HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1990HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1991HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1992HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1994HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1995HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1996HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1997HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1998HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest1999HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest2001HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest2002HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest2003HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest2004HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest2005HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest2006HostTestCases
|
armeabi-v7a | |
CtsJvmtiRunTest2007HostTestCases
|
armeabi-v7a | |
CtsLocationCoarseTestCases
|
armeabi-v7a | |
CtsLocationFineTestCases
|
armeabi-v7a | |
CtsLocationGnssTestCases
|
armeabi-v7a | |
CtsLocationNoneTestCases
|
armeabi-v7a | |
CtsLocationPrivilegedTestCases
|
armeabi-v7a | |
CtsMediaV2TestCases
|
armeabi-v7a | |
CtsMimeMapTestCases
|
armeabi-v7a | |
CtsNativeEncryptionTestCases
|
armeabi-v7a | |
CtsNativeMediaMetricsTestCases
|
armeabi-v7a | |
CtsPackageWatchdogTestCases
|
armeabi-v7a | |
CtsSdkExtensionsTestCases
|
armeabi-v7a | |
CtsTextClassifierTestCases
|
armeabi-v7a | |
CtsThermalTestCases
|
armeabi-v7a | |
CtsUsbManagerTestCases
|
armeabi-v7a |
Removed modules
Many key new modules and test changes are introduced in Android 11 for (Build date - 07/06/2020) CTS 11 R1 (Dev build 6656047) build vs. CTS 10_R5 and for platform build RP1A.200706.002.
A total of 13 modules are removed.
| Test module name | ABI |
|---|---|
CtsDownloadManagerLegacy
|
arm64-v8a |
CtsLocation2TestCases
|
arm64-v8a |
CtsLocation2TestCases[instant]
|
arm64-v8a |
CtsLocationTestCases
|
arm64-v8a |
CtsLocationTestCases[instant]
|
arm64-v8a |
cts-shared-libs-all.api
|
arm64-v8a |
CtsLocation2TestCases
|
armabi-v7a |
CtsLocationTestCases
|
armabi-v7a |
CtsSelinuxEphemeralTestCases
|
armabi-v7a |
CtsSelinuxTargetSdk25TestCases
|
armabi-v7a |
CtsSelinuxTargetSdk27TestCases
|
armabi-v7a |
CtsSelinuxTargetSdk28TestCases
|
armabi-v7a |
CtsSelinuxTargetSdkCurrentTestCases
|
armabi-v7a |