New and updated documentation for Android 10 CTS features is as follows.
| Feature | Description | Added/Updated |
|---|---|---|
| Running CTS tests | CTS-Instant test suite is part of the CTS test suite. | Updated |
| CTS Verifier Pro Audio Test | The CTS Verifier Pro Audio test verifies the compliance of audio peripherals by measuring round-trip latency through the audio path. | Added |
| Test Harness Mode | Test Harness Mode allows the developers to automate a device or a fleet of devices. | Added |
| CTS Verifier MIDI Tests | The CTS Verifier MIDI test tests MIDI functionality with USB MIDI interfaces, Bluetooth MIDI interfaces, and a virtual MIDI device path. | Added |
| CTS Shim APEX | Developers can preinstall the CtsShimApex package on a device
to write CTS tests for APEX management. |
Updated |
| CTS Verifier for Instant Apps | CTS Verifier for Instant Apps increases Android Compatibility test coverage for Instant Apps by using CTS Verifier to test features that can't be fully automated due to OEM-specific UIs, such as system UIs. | Added |
| Using CTS Verifier | CTS Verifier provides tests for APIs and functions that can't be tested on a stationary device without manual input, such as audio quality, touchscreen, accelerometer, and camera. | Updated |
New modules and test cases
Many key new modules and test changes are introduced in Android 10 for CTS. A total of 64 modules are added and 10 modules are removed. In addition, a total of 118 new modules are added for CTS-Instant.
| Added (CTS Q 06/27 build vs. CTS 9.0_r8) | Removed (CTS Q 06/27 build vs. CTS 9.0_r8) |
|---|---|
CtsActivityManagerBackgroundActivityTestCases
|
CtsActivityManagerDeviceSdk25TestCases
|
CtsAndroidTestBase28ApiSignatureTestCases
|
CtsActivityManagerDeviceTestCases
|
CtsAndroidTestBaseCurrentApiSignatureTestCases
|
CtsAlarmClockTestCases
|
CtsAngleIntegrationHostTestCases
|
CtsAndroidTestBase27ApiSignatureTestCases
|
CtsAppBindingHostTestCases
|
CtsDebugTestCases
|
CtsAppOpsTestCases
|
CtsExternalSourcesTestCases
|
CtsAppPredictionServiceTestCases
|
CtsJankDeviceTestCases
|
CtsAtomicInstallTestCases
|
CtsPreference2TestCases
|
CtsAttentionServiceDeviceTestCases
|
CtsUiDeviceTestCases
|
CtsClassLoaderFactoryInMemoryDexClassLoader
|
CtsVmTestCases
|
CtsClassLoaderFactoryPathClassLoaderTestCases
|
|
CtsClassloaderSplitsHostTestCases
|
|
CtsContentCaptureServiceTestCases
|
|
CtsContentSuggestionsTestCases
|
|
CtsDeviceConfigTestCases
|
|
CtsDownloadManagerApi28
|
|
CtsDownloadManagerLegacy
|
|
CtsDropBoxManagerTestCases
|
|
CtsExtendedMockingTestCases
|
|
CtsHiddenApiBlacklistApi28TestCases
|
|
CtsJdwpTunnelHostTestCases
|
|
CtsJvmtiRunTest1953HostTestCases
|
|
CtsJvmtiRunTest1958HostTestCases
|
|
CtsLegacyNotification20TestCases
|
|
CtsLegacyNotification27TestCases
|
|
CtsLegacyNotification28TestCases
|
|
CtsLegacyNotification29TestCases
|
|
CtsLibcoreApiEvolutionTestCases
|
|
CtsNNAPIBenchmarkTestCases
|
|
CtsNativeMidiTestCases
|
|
CtsNativeNetDnsTestCases
|
|
CtsNdkBinderTestCases
|
|
CtsNetApi23TestCases
|
|
CtsNetTestCasesInternetPermission
|
|
CtsNetTestCasesUpdateStatsPermission
|
|
CtsNoPermissionTestCases
|
|
CtsNoPermissionTestCases25
|
|
CtsPackageInstallTestCases
|
|
CtsPackageInstallerTapjackingTestCases
|
|
CtsPackageUninstallTestCases
|
|
CtsPermissionTestCasesSdk28
|
|
CtsPermissionTestCasesTelephony
|
|
CtsProviderUiTestCases
|
|
CtsRcsTestCases
|
|
CtsRoleTestCases
|
|
CtsRollbackManagerHostTestCases
|
|
CtsSelinuxEphemeralTestCases
|
|
CtsSelinuxTargetSdk28TestCases
|
|
CtsSharedLibsApiSignatureTestCases
|
|
CtsSignedConfigHostTestCases
|
|
CtsStagedInstallHostTestCases
|
|
CtsTelephony3TestCases
|
|
CtsTelephonyProviderTestCases
|
|
CtsTelephonySdk28TestCases
|
|
CtsTestHarnessModeTestCases
|
|
CtsTfliteNnapiDelegateTestCases
|
|
CtsUiRenderingTestCases27
|
|
CtsUsesLibraryHostTestCases
|
|
CtsViewInspectorAnnotationProcessorTestCases
|
|
CtsViewTestCasesSdk28
|
|
CtsWifiBroadcastsHostTestCases
|
|
CtsWindowManagerSdk25TestCases
|
|
CtsWindowManagerSdk28TestCases
|
|
cts-shared-libs-all.api
|
|
CtsAbiOverrideHostTestCases[instant]
|
|
CtsAccelerationTestCases[instant]
|
|
CtsAccessibilityServiceTestCases[instant]
|
|
CtsAccessibilityTestCases[instant]
|
|
CtsAccountManagerTestCases[instant]
|
|
CtsAlarmManagerTestCases[instant]
|
|
CtsAndroidAppTestCases[instant]
|
|
CtsAngleIntegrationHostTestCases[instant]
|
|
CtsAnimationTestCases[instant]
|
|
CtsAppComponentFactoryTestCases[instant]
|
|
CtsAppOpsTestCases[instant]
|
|
CtsAppTestCases[instant]
|
|
CtsAppUsageHostTestCases[instant]
|
|
CtsAppWidgetTestCases[instant]
|
|
CtsAssistTestCases[instant]
|
|
CtsAtraceHostTestCases[instant]
|
|
CtsAutoFillServiceTestCases[instant]
|
|
CtsBackgroundRestrictionsTestCases[instant]
|
|
CtsCameraTestCases[instant]
|
|
CtsCarTestCases[instant]
|
|
CtsClassLoaderFactoryInMemoryDexClassLoader
|
|
CtsClassLoaderFactoryPathClassLoaderTestCases[instant]
|
|
CtsClassloaderSplitsHostTestCases[instant]
|
|
CtsColorModeTestCases[instant]
|
|
CtsContentCaptureServiceTestCases[instant]
|
|
CtsContentTestCases[instant]
|
|
CtsDatabaseTestCases[instant]
|
|
CtsDeviceConfigTestCases[instant]
|
|
CtsDisplayTestCases[instant]
|
|
CtsDpiTestCases[instant]
|
|
CtsDreamsTestCases[instant]
|
|
CtsDrmTestCases[instant]
|
|
CtsDynamicLinkerTestCases[instant]
|
|
CtsEffectTestCases[instant]
|
|
CtsExtendedMockingTestCases[instant]
|
|
CtsFileSystemTestCases[instant]
|
|
CtsFragmentTestCasesSdk26[instant]
|
|
CtsFragmentTestCases[instant]
|
|
CtsGestureTestCases[instant]
|
|
CtsGraphicsTestCases[instant]
|
|
CtsHostsideNetworkTests[instant]
|
|
CtsHostsideWebViewTests[instant]
|
|
CtsIncidentHostTestCases[instant]
|
|
CtsInlineMockingTestCases[instant]
|
|
CtsInputMethodServiceHostTestCases[instant]
|
|
CtsInputMethodTestCases[instant]
|
|
CtsJdwpTestCases[instant]
|
|
CtsJniTestCases[instant]
|
|
CtsLocation2TestCases[instant]
|
|
CtsLocationTestCases[instant]
|
|
CtsMediaHostTestCases[instant]
|
|
CtsMediaTestCases[instant]
|
|
CtsMockingDebuggableTestCases[instant]
|
|
CtsMockingTestCases[instant]
|
|
CtsMultiUserHostTestCases[instant]
|
|
CtsMultiUserTestCases[instant]
|
|
CtsNNAPIBenchmarkTestCases[instant]
|
|
CtsNativeMediaAAudioTestCases[instant]
|
|
CtsNativeMediaSlTestCases[instant]
|
|
CtsNativeMediaXaTestCases[instant]
|
|
CtsNativeNetDnsTestCases[instant]
|
|
CtsNativeNetTestCases[instant]
|
|
CtsNdkBinderTestCases[instant]
|
|
CtsNetSecConfigAttributeTestCases[instant]
|
|
CtsNetSecConfigBasicDebugDisabled
|
|
CtsNetSecConfigBasicDebugEnabledTestCases[instant]
|
|
CtsNetSecConfigBasicDomainConfigTestCases[instant]
|
|
CtsNetSecConfigCleartextTrafficTestCases[instant]
|
|
CtsNetSecConfigInvalidPinTestCases[instant]
|
|
CtsNetSecConfigNestedDomainConfig
|
|
CtsNetSecConfigResourcesSrcTestCases[instant]
|
|
CtsNetTestCasesInternetPermission[instant]
|
|
CtsNetTestCasesUpdateStatsPermission[instant]
|
|
CtsNetTestCases[instant]
|
|
CtsOmapiTestCases[instant]
|
|
CtsOsHostTestCases[instant]
|
|
CtsOsTestCases[instant]
|
|
CtsPackageInstallTestCases[instant]
|
|
CtsPdfTestCases[instant]
|
|
CtsPermission2TestCases[instant]
|
|
CtsPermissionTestCases
Sdk28[instant]
|
|
CtsPermissionTestCasesTelephony[instant]
|
|
CtsPermissionTestCases[instant]
|
|
CtsPreferenceTestCases[instant]
|
|
CtsPrintTestCases[instant]
|
|
CtsProtoTestCases[instant]
|
|
CtsRenderscriptTestCases[instant]
|
|
CtsSampleDeviceTestCases[instant]
|
|
CtsSeccompHostTestCases[instant]
|
|
CtsSecureElementAccessControlTestCases1[instant]
|
|
CtsSecureElementAccessControlTestCases2[instant]
|
|
CtsSecureElementAccessControlTestCases3[instant]
|
|
CtsSecurityTestCases[instant]
|
|
CtsSelinuxEphemeralTestCases[instant]
|
|
CtsSensorTestCases[instant]
|
|
CtsStatsdHostTestCases[instant]
|
|
CtsSystemUiHostTestCases[instant]
|
|
CtsSystemUiTestCases[instant]
|
|
CtsTelephony2TestCases[instant]
|
|
CtsTextTestCases[instant]
|
|
CtsToastTestCases[instant]
|
|
CtsUiAutomationTestCases[instant]
|
|
CtsUiRenderingTestCases27[instant]
|
|
CtsUiRenderingTestCases[instant]
|
|
CtsUidIsolationTestCases[instant]
|
|
CtsUsageStatsTestCases[instant]
|
|
CtsUsbTests[instant]
|
|
CtsUtilTestCases[instant]
|
|
CtsViewInspectorAnnotationProcessorTestCases[instant]
|
|
CtsViewTestCasesSdk28[instant]
|
|
CtsVoiceInteractionTestCases[instant]
|
|
CtsVoiceSettingsTestCases[instant]
|
|
CtsWebkitTestCases[instant]
|
|
CtsWidgetTestCases[instant]
|
|
CtsWifiBroadcastsHostTestCases[instant]
|
|
signed-CtsSecureElementAccessControlTestCases1[instant]
|
|
signed-CtsSecureElementAccessControlTestCases2[instant]
|
|
signed-CtsSecureElementAccessControlTestCases3[instant]
|
The table below describes the CTS Verifier modules QP1A.190627.001 (CTS Q 06/27 build vs. CTS 9.0_r8).
| Audio |
|---|
| MIDI Test |
| Native MIDI API Test |
| Pro Audio Test |
| Camera |
| Camera Performance |
| Managed Provisioning - BYOD Managed Provisioning |
| Personal ringtones |
| Non-market app installation restrictions |
| Non-market app installation restrictions - Disable non-market apps |
| Non-market app installation restrictions - Enable non-market apps |
| Non-market app installation restrictions - Disable non-market apps (global restriction) |
| Non-market app installation restrictions - Enable non-market apps (global restriction) |
| Disable primary user non-market apps (global restriction) |
| Enable primary user non-market apps (global restriction) |
| Confilm pattern lock test |
| Uninstall work app from launcher |
| Managed Provisioning - Device Owner Tests |
| Policy transparency test - Disallow config date time |
| Policy transparency test - Disallow config screen timeout |
| Policy transparency test - Disallow config brightness |
| Managed User - Policy transparency test - Disallow config date time |
| Managed User - Policy transparency test - Disallow config screen timeout |
| Managed User - Policy transparency test - Disallow config brightness |
| Customize Lock Screen message |
| Networking - Bluetooth Test |
| Bluetooth LE CoC Insecure Client Test - 01 Bluetooth LE CoC Client Test |
| Bluetooth LE CoC Insecure Server Test - 01 Bluetooth LE CoC Server Test |
| Bluetooth LE CoC Secure Client Test - 01 Bluetooth LE CoC Client Test |
| Bluetooth LE CoC Secure Server Test - 01 Bluetooth LE CoC Server Test |
| Networking - Wi-Fi Direct Test |
| Group Owner With Config Test |
| Group Client With Config Test - Join p2p group test (config) |
| Group Owner With Config 2G Band Test |
| Group Client With Config 2G Band Test - Join p2p group test (2.4G config) |
| Group Owner With Config Fixed Frequency Test |
| Group Client With Config Fixed Frequency Test - Join p2p group test (2447 MHz config) |
| Networking - Wi-Fi Test |
| Network Request with a specific SSID and BSSID |
| Network Request with a SSID and BSSID pattern |
| Network Request with a specific network that is unavailable |
| Network suggestion with SSID |
| Network suggestion with SSID and BSSID |
| Network suggestion with SSID and post connection broadcast |
| Notifications |
| Bubble Notification Tests |
| Other |
| Recent Task Removal Test |
| Security |
| Biometric Prompt Bound Keys Test |
| Biometric Test |
| Set New Password Complexity Test |
| Step Permission Test |
| Titles |
| Tile Service Test |