Google is committed to advancing racial equity for Black communities. See how.

Android 11 CTS Release Notes

Many key new modules and test changes are introduced in Android 11 for CTS.

CTS Features

New and updated documentation for Android 11 CTS features is as follows.

Feature Description Added/Updated
Automatic Test Retry Tradefed auto-retry helps to reduce the impact of flakiness on the runs. Updated
Automated log on failure collection Auto-log collection helps get better logs for failures directly. Updated
Command to allow access to non-SDK interfaces Users should run CTS verifier new command adb shell settings put global hidden_api_policy 1 before installing CTS Verifier so it can access non-SDK interfaces Updated
CTS verifier new analog headset test Added CTS Verifier test for analog headset jacks. Any Android-compatible analog headset works. Updated
Command to install any required APK Users can install any required APK with new command adb install xxxx.apk. Updated
Command to save reports Users should run CTS verifier new command adb shell appops set com android.cts.verifier MANAGE_EXTERNAL_STORAGE 0 command before saving reports. Updated
A test for safe insets of DisplayCutout This test is to make sure that the area inside the safe insets from the DisplayCutout should be fully visible and touchable. Updated
CTS device interaction helper module CTS device interaction helper module allows the customization of how CTS interacts with a limited set of replaced UI elements. Updated
CTS test for APK fs-verity integration CTS host-side test with a test helper app is added to enforce the new CDD requirement (C-0-3, C-0-4, and C-0-5). This feature is mandatory for new devices launched with Android 11 with kernel dependency. Similar to CtsShimPrebuilt, Google’s public key is checked in AOSP, and should be kept on release build. Updated
CTS tests for APEX management APIs

Starting with Android 11, the CtsShimApex package contains two prebuilt apps that CTS uses to test privileges and permissions. If the OEM device doesn't support APEX package management, or if the device is running version 10 or lower, the two prebuilt apps must be pre installed in the system separately.

For more details, refer to CTS shim packages

.
Updated
CtsStatsdHostTestCases is tagged to be sim card required CtsStatsdHostTestCase test module is tagged with the SIM_CARD token, as UidAtomTests#testMobileBytesTransfer requires regular SIM card with working data connection to be tested. Updated
CTS SIM test plan A new cts-sim plan is available so that the subset of tests can be run easily on a device with SIM card. Users need a voice and data activated SIM to run these tests. Updated
Updated Wi-Fi RTT access point New AP devices support the ResponderLocation feature. For more information, see Wi-Fi location with RTT. Updated
OpenJDK 11 Android 11 CTS should be run using the OpenJDK 11 toolchain. Updated
Developer UICC specification for CTS testing To run the CTS carrier API tests, the device needs to use a SIM card with carrier privileges. Updated

Added modules

Many key new modules and test changes are introduced in Android 11 for (Build date - 07/06/2020) CTS 11 R1 (Dev build 6656047) build vs. CTS 10_R5 and for platform build RP1A.200706.002.

A total of 225 modules are added.

Test module name ABI
cts-platform-version-check arm64-v8a
cts-system-all.api[instant] arm64-v8a
CtsAccessibilityServiceSdk29TestCases arm64-v8a
CtsAccessibilityServiceSdk29TestCases[instant] arm64-v8a
CtsAccountsHostTestCases arm64-v8a
CtsAccountsHostTestCases[instant] arm64-v8a
CtsAndroidTestBase28ApiSignatureTestCases[instant] arm64-v8a
CtsAndroidTestBaseCurrentApiSignatureTestCases[instant] arm64-v8a
CtsAndroidTestMockCurrentApiSignatureTestCases[instant] arm64-v8a
CtsAndroidTestRunnerCurrentApiSignatureTestCases[instant] arm64-v8a
CtsApacheHttpLegacy27ApiSignatureTestCases[instant] arm64-v8a
CtsApacheHttpLegacyCurrentApiSignatureTestCases[instant] arm64-v8a
CtsApacheHttpLegacyUsesLibraryApiSignatureTestCases[instant] arm64-v8a
CtsAppCompatHostTestCases arm64-v8a
CtsAppCompatHostTestCases[instant] arm64-v8a
CtsAppEnumerationTestCases arm64-v8a
CtsAppExitTestCases arm64-v8a
CtsAppExitTestCases[instant] arm64-v8a
CtsAppIntegrityDeviceTestCases arm64-v8a
CtsBionicAppTestCases arm64-v8a
CtsBionicAppTestCases[instant] arm64-v8a
CtsBlobStoreHostTestCases arm64-v8a
CtsBlobStoreHostTestHelper arm64-v8a
CtsBlobStoreTestCases arm64-v8a
CtsBlobStoreTestHelper arm64-v8a
CtsBlobStoreTestHelperDiffSig arm64-v8a
CtsBlobStoreTestHelperDiffSig2 arm64-v8a
CtsCalendarProviderTestCases arm64-v8a
CtsCarHostTestCases arm64-v8a
CtsCodePathHostTestCases arm64-v8a
CtsContactsProviderTestCases arm64-v8a
CtsControlsDeviceTestCases arm64-v8a
CtsCurrentApiSignatureTestCases[instant] arm64-v8a
CtsDownloadManagerInstaller arm64-v8a
CtsDynamicMimeHostTestCases arm64-v8a
CtsExtractNativeLibsHostTestCases arm64-v8a
CtsFsMgrTestCases arm64-v8a
CtsGpuProfilingDataTestCases arm64-v8a
CtsGwpAsanTestCases arm64-v8a
CtsGwpAsanTestCases[instant] arm64-v8a
CtsHdmiCecHostTestCases arm64-v8a
CtsHiddenApiBlacklistApi27TestCases[instant] arm64-v8a
CtsHiddenApiBlacklistApi28TestCases[instant] arm64-v8a
CtsHiddenApiBlacklistCurrentApiTestCases[instant] arm64-v8a
CtsHiddenApiBlacklistDebugClassTestCases[instant] arm64-v8a
CtsHiddenApiBlacklistTestApiTestCases arm64-v8a
CtsHiddenApiBlacklistTestApiTestCases[instant] arm64-v8a
CtsHiddenApiKillswitchDebugClassTestCases[instant] arm64-v8a
CtsHiddenApiKillswitchWhitelistTestCases[instant] arm64-v8a
CtsHiddenApiKillswitchWildcardTestCases[instant] arm64-v8a
CtsIdentityTestCases arm64-v8a
CtsIkeTestCases arm64-v8a
CtsIncrementalInstallHostTestCases arm64-v8a
CtsInitTestCases arm64-v8a
CtsInstantAppTests arm64-v8a
CtsJvmtiRunTest1962HostTestCases arm64-v8a
CtsJvmtiRunTest1967HostTestCases arm64-v8a
CtsJvmtiRunTest1968HostTestCases arm64-v8a
CtsJvmtiRunTest1969HostTestCases arm64-v8a
CtsJvmtiRunTest1970HostTestCases arm64-v8a
CtsJvmtiRunTest1971HostTestCases arm64-v8a
CtsJvmtiRunTest1974HostTestCases arm64-v8a
CtsJvmtiRunTest1975HostTestCases arm64-v8a
CtsJvmtiRunTest1976HostTestCases arm64-v8a
CtsJvmtiRunTest1977HostTestCases arm64-v8a
CtsJvmtiRunTest1978HostTestCases arm64-v8a
CtsJvmtiRunTest1979HostTestCases arm64-v8a
CtsJvmtiRunTest1981HostTestCases arm64-v8a
CtsJvmtiRunTest1982HostTestCases arm64-v8a
CtsJvmtiRunTest1983HostTestCases arm64-v8a
CtsJvmtiRunTest1984HostTestCases arm64-v8a
CtsJvmtiRunTest1988HostTestCases arm64-v8a
CtsJvmtiRunTest1989HostTestCases arm64-v8a
CtsJvmtiRunTest1990HostTestCases arm64-v8a
CtsJvmtiRunTest1991HostTestCases arm64-v8a
CtsJvmtiRunTest1992HostTestCases arm64-v8a
CtsJvmtiRunTest1994HostTestCases arm64-v8a
CtsJvmtiRunTest1995HostTestCases arm64-v8a
CtsJvmtiRunTest1996HostTestCases arm64-v8a
CtsJvmtiRunTest1997HostTestCases arm64-v8a
CtsJvmtiRunTest1998HostTestCases arm64-v8a
CtsJvmtiRunTest1999HostTestCases arm64-v8a
CtsJvmtiRunTest2001HostTestCases arm64-v8a
CtsJvmtiRunTest2002HostTestCases arm64-v8a
CtsJvmtiRunTest2003HostTestCases arm64-v8a
CtsJvmtiRunTest2004HostTestCases arm64-v8a
CtsJvmtiRunTest2005HostTestCases arm64-v8a
CtsJvmtiRunTest2006HostTestCases arm64-v8a
CtsJvmtiRunTest2007HostTestCases arm64-v8a
CtsLocationCoarseTestCases arm64-v8a
CtsLocationCoarseTestCases[instant] arm64-v8a
CtsLocationFineTestCases arm64-v8a
CtsLocationFineTestCases[instant] arm64-v8a
CtsLocationGnssTestCases arm64-v8a
CtsLocationGnssTestCases[instant] arm64-v8a
CtsLocationNoneTestCases arm64-v8a
CtsLocationNoneTestCases[instant] arm64-v8a
CtsLocationPrivilegedTestCases arm64-v8a
CtsLocationPrivilegedTestCases[instant] arm64-v8a
CtsMatchFlagTestCases arm64-v8a
CtsMediaParserTestCases arm64-v8a
CtsMediaV2TestCases arm64-v8a
CtsMimeMapTestCases arm64-v8a
CtsNativeEncryptionTestCases arm64-v8a
CtsNativeEncryptionTestCases[instant] arm64-v8a
CtsNativeMediaMetricsTestCases arm64-v8a
CtsNativeMediaMetricsTestCases[instant] arm64-v8a
CtsNfcTestCases arm64-v8a
CtsPackageInstallAppOpDefaultTestCases arm64-v8a
CtsPackageInstallAppOpDefaultTestCases[instant] arm64-v8a
CtsPackageInstallAppOpDeniedTestCases arm64-v8a
CtsPackageInstallAppOpDeniedTestCases[instant] arm64-v8a
CtsPackageWatchdogTestCases arm64-v8a
CtsPermission3TestCases arm64-v8a
CtsQuickAccessWalletTestCases arm64-v8a
CtsQuickAccessWalletTestCases[instant] arm64-v8a
CtsResourcesLoaderTests arm64-v8a
CtsSdkExtensionsTestCases arm64-v8a
CtsSdkExtensionsTestCases[instant] arm64-v8a
CtsSecureFrpInstallTestCases arm64-v8a
CtsSelinuxTargetSdk29TestCases arm64-v8a
CtsSettingsHostTestCases arm64-v8a
CtsSharedLibsApiSignatureTestCases[instant] arm64-v8a
CtsSharesheetTestCases arm64-v8a
CtsShortcutManagerLauncher1 arm64-v8a
CtsShortcutManagerLauncher2 arm64-v8a
CtsShortcutManagerLauncher3 arm64-v8a
CtsShortcutManagerLauncher4 arm64-v8a
CtsShortcutManagerPackage1 arm64-v8a
CtsShortcutManagerPackage2 arm64-v8a
CtsShortcutManagerPackage3 arm64-v8a
CtsShortcutManagerPackage4 arm64-v8a
CtsShortcutManagerThrottlingTest arm64-v8a
CtsSoundTriggerTestCases arm64-v8a
CtsSoundTriggerTestCases[instant] arm64-v8a
CtsStrictJavaPackagesTestCases arm64-v8a
CtsSuspendAppsPermissionTestCases arm64-v8a
CtsSuspendAppsTestCases arm64-v8a
CtsSystemApiAnnotationTestCases[instant] arm64-v8a
CtsSystemApiSignatureTestCases[instant] arm64-v8a
CtsTaggingHostTestCases arm64-v8a
CtsTaggingHostTestCases[instant] arm64-v8a
CtsTelephonyHostCases arm64-v8a
CtsTelephonyProviderHostCases arm64-v8a
CtsTelephonyTestCasesPermissionReadPhoneState arm64-v8a
CtsTelephonyTestCasesPermissionReadPhoneState[instant] arm64-v8a
CtsTetheringTest arm64-v8a
CtsTextClassifierTestCases arm64-v8a
CtsThermalTestCases arm64-v8a
CtsUsbManagerTestCases arm64-v8a
CtsUserspaceRebootHostSideTestCases arm64-v8a
CtsWidgetTestCases29 arm64-v8a
CtsWidgetTestCases29[instant] arm64-v8a
CtsWifiTestCases arm64-v8a
CtsWifiTestCases[instant] arm64-v8a
CtsWindowManagerJetpackTestCases arm64-v8a
CtsWindowManagerSdk29TestCases arm64-v8a
signed-CtsOmapiTestCases arm64-v8a
signed-CtsOmapiTestCases[instant] arm64-v8a
CtsScopedStorageHostTest arm64-v8a
CtsScopedStorageHostTest[instant] arm64-v8a
LegacyStorageTest arm64-v8a
LegacyStorageTest[instant] arm64-v8a
ScopedStorageTest arm64-v8a
ScopedStorageTest[instant] armeabi-v7a
CtsAdbHostTestCases arm64-v8a
CtsCarTestCases[instant] arm64-v8a
CtsAppOpsTestCases armeabi-v7a
CtsBionicAppTestCases armeabi-v7a
CtsCodePathHostTestCases armeabi-v7a
CtsExtractNativeLibsHostTestCases armeabi-v7a
CtsFsMgrTestCases armeabi-v7a
CtsGpuProfilingDataTestCases armeabi-v7a
CtsGwpAsanTestCases armeabi-v7a
CtsIdentityTestCases armeabi-v7a
CtsIncrementalInstallHostTestCases armeabi-v7a
CtsJvmtiRunTest1962HostTestCases armeabi-v7a
CtsJvmtiRunTest1967HostTestCases armeabi-v7a
CtsJvmtiRunTest1968HostTestCases armeabi-v7a
CtsJvmtiRunTest1969HostTestCases armeabi-v7a
CtsJvmtiRunTest1970HostTestCases armeabi-v7a
CtsJvmtiRunTest1971HostTestCases armeabi-v7a
CtsJvmtiRunTest1974HostTestCases armeabi-v7a
CtsJvmtiRunTest1975HostTestCases armeabi-v7a
CtsJvmtiRunTest1976HostTestCases armeabi-v7a
CtsJvmtiRunTest1977HostTestCases armeabi-v7a
CtsJvmtiRunTest1978HostTestCases armeabi-v7a
CtsJvmtiRunTest1979HostTestCases armeabi-v7a
CtsJvmtiRunTest1981HostTestCases armeabi-v7a
CtsJvmtiRunTest1982HostTestCases armeabi-v7a
CtsJvmtiRunTest1983HostTestCases armeabi-v7a
CtsJvmtiRunTest1984HostTestCases armeabi-v7a
CtsJvmtiRunTest1988HostTestCases armeabi-v7a
CtsJvmtiRunTest1989HostTestCases armeabi-v7a
CtsJvmtiRunTest1990HostTestCases armeabi-v7a
CtsJvmtiRunTest1991HostTestCases armeabi-v7a
CtsJvmtiRunTest1992HostTestCases armeabi-v7a
CtsJvmtiRunTest1994HostTestCases armeabi-v7a
CtsJvmtiRunTest1995HostTestCases armeabi-v7a
CtsJvmtiRunTest1996HostTestCases armeabi-v7a
CtsJvmtiRunTest1997HostTestCases armeabi-v7a
CtsJvmtiRunTest1998HostTestCases armeabi-v7a
CtsJvmtiRunTest1999HostTestCases armeabi-v7a
CtsJvmtiRunTest2001HostTestCases armeabi-v7a
CtsJvmtiRunTest2002HostTestCases armeabi-v7a
CtsJvmtiRunTest2003HostTestCases armeabi-v7a
CtsJvmtiRunTest2004HostTestCases armeabi-v7a
CtsJvmtiRunTest2005HostTestCases armeabi-v7a
CtsJvmtiRunTest2006HostTestCases armeabi-v7a
CtsJvmtiRunTest2007HostTestCases armeabi-v7a
CtsLocationCoarseTestCases armeabi-v7a
CtsLocationFineTestCases armeabi-v7a
CtsLocationGnssTestCases armeabi-v7a
CtsLocationNoneTestCases armeabi-v7a
CtsLocationPrivilegedTestCases armeabi-v7a
CtsMediaV2TestCases armeabi-v7a
CtsMimeMapTestCases armeabi-v7a
CtsNativeEncryptionTestCases armeabi-v7a
CtsNativeMediaMetricsTestCases armeabi-v7a
CtsPackageWatchdogTestCases armeabi-v7a
CtsSdkExtensionsTestCases armeabi-v7a
CtsTextClassifierTestCases armeabi-v7a
CtsThermalTestCases armeabi-v7a
CtsUsbManagerTestCases armeabi-v7a

Removed modules

Many key new modules and test changes are introduced in Android 11 for (Build date - 07/06/2020) CTS 11 R1 (Dev build 6656047) build vs. CTS 10_R5 and for platform build RP1A.200706.002.

A total of 13 modules are removed.

Test module name ABI
CtsDownloadManagerLegacy arm64-v8a
CtsLocation2TestCases arm64-v8a
CtsLocation2TestCases[instant] arm64-v8a
CtsLocationTestCases arm64-v8a
CtsLocationTestCases[instant] arm64-v8a
cts-shared-libs-all.api arm64-v8a
CtsLocation2TestCases armabi-v7a
CtsLocationTestCases armabi-v7a
CtsSelinuxEphemeralTestCases armabi-v7a
CtsSelinuxTargetSdk25TestCases armabi-v7a
CtsSelinuxTargetSdk27TestCases armabi-v7a
CtsSelinuxTargetSdk28TestCases armabi-v7a
CtsSelinuxTargetSdkCurrentTestCases armabi-v7a