CTS Release Notes

New and updated documentation for Android 10 CTS features is as follows.

Feature Description Added/Updated
Running CTS tests CTS-Instant test suite is part of the CTS test suite. Updated
CTS Verifier Pro Audio Test The CTS Verifier Pro Audio test verifies the compliance of audio peripherals by measuring round-trip latency through the audio path. Added
Test Harness Mode Test Harness Mode allows the developers to automate a device or a fleet of devices. Added
CTS Verifier MIDI Tests The CTS Verifier MIDI test tests MIDI functionality with USB MIDI interfaces, Bluetooth MIDI interfaces, and a virtual MIDI device path. Added
CTS Shim APEX Developers can preinstall the CtsShimApex package on a device to write CTS tests for APEX management. Updated
CTS Verifier for Instant Apps CTS Verifier for Instant Apps increases Android Compatibility test coverage for Instant Apps by using CTS Verifier to test features that can't be fully automated due to OEM-specific UIs, such as system UIs. Added
Using CTS Verifier CTS Verifier provides tests for APIs and functions that can't be tested on a stationary device without manual input, such as audio quality, touchscreen, accelerometer, and camera. Updated

New modules and test cases

Many key new modules and test changes are introduced in Android 10 for CTS. A total of 64 modules are added and 10 modules are removed. In addition, a total of 118 new modules are added for CTS-Instant.

Added (CTS Q 06/27 build vs. CTS 9.0_r8) Removed (CTS Q 06/27 build vs. CTS 9.0_r8)
CtsActivityManagerBackgroundActivityTestCases CtsActivityManagerDeviceSdk25TestCases
CtsAndroidTestBase28ApiSignatureTestCases CtsActivityManagerDeviceTestCases
CtsAndroidTestBaseCurrentApiSignatureTestCases CtsAlarmClockTestCases
CtsAngleIntegrationHostTestCases CtsAndroidTestBase27ApiSignatureTestCases
CtsAppBindingHostTestCases CtsDebugTestCases
CtsAppOpsTestCases CtsExternalSourcesTestCases
CtsAppPredictionServiceTestCases CtsJankDeviceTestCases
CtsAtomicInstallTestCases CtsPreference2TestCases
CtsAttentionServiceDeviceTestCases CtsUiDeviceTestCases
CtsClassLoaderFactoryInMemoryDexClassLoader
TestCases
CtsVmTestCases
CtsClassLoaderFactoryPathClassLoaderTestCases
CtsClassloaderSplitsHostTestCases
CtsContentCaptureServiceTestCases
CtsContentSuggestionsTestCases
CtsDeviceConfigTestCases
CtsDownloadManagerApi28
CtsDownloadManagerLegacy
CtsDropBoxManagerTestCases
CtsExtendedMockingTestCases
CtsHiddenApiBlacklistApi28TestCases
CtsJdwpTunnelHostTestCases
CtsJvmtiRunTest1953HostTestCases
CtsJvmtiRunTest1958HostTestCases
CtsLegacyNotification20TestCases
CtsLegacyNotification27TestCases
CtsLegacyNotification28TestCases
CtsLegacyNotification29TestCases
CtsLibcoreApiEvolutionTestCases
CtsNNAPIBenchmarkTestCases
CtsNativeMidiTestCases
CtsNativeNetDnsTestCases
CtsNdkBinderTestCases
CtsNetApi23TestCases
CtsNetTestCasesInternetPermission
CtsNetTestCasesUpdateStatsPermission
CtsNoPermissionTestCases
CtsNoPermissionTestCases25
CtsPackageInstallTestCases
CtsPackageInstallerTapjackingTestCases
CtsPackageUninstallTestCases
CtsPermissionTestCasesSdk28
CtsPermissionTestCasesTelephony
CtsProviderUiTestCases
CtsRcsTestCases
CtsRoleTestCases
CtsRollbackManagerHostTestCases
CtsSelinuxEphemeralTestCases
CtsSelinuxTargetSdk28TestCases
CtsSharedLibsApiSignatureTestCases
CtsSignedConfigHostTestCases
CtsStagedInstallHostTestCases
CtsTelephony3TestCases
CtsTelephonyProviderTestCases
CtsTelephonySdk28TestCases
CtsTestHarnessModeTestCases
CtsTfliteNnapiDelegateTestCases
CtsUiRenderingTestCases27
CtsUsesLibraryHostTestCases
CtsViewInspectorAnnotationProcessorTestCases
CtsViewTestCasesSdk28
CtsWifiBroadcastsHostTestCases
CtsWindowManagerSdk25TestCases
CtsWindowManagerSdk28TestCases
cts-shared-libs-all.api
CtsAbiOverrideHostTestCases[instant]
CtsAccelerationTestCases[instant]
CtsAccessibilityServiceTestCases[instant]
CtsAccessibilityTestCases[instant]
CtsAccountManagerTestCases[instant]
CtsAlarmManagerTestCases[instant]
CtsAndroidAppTestCases[instant]
CtsAngleIntegrationHostTestCases[instant]
CtsAnimationTestCases[instant]
CtsAppComponentFactoryTestCases[instant]
CtsAppOpsTestCases[instant]
CtsAppTestCases[instant]
CtsAppUsageHostTestCases[instant]
CtsAppWidgetTestCases[instant]
CtsAssistTestCases[instant]
CtsAtraceHostTestCases[instant]
CtsAutoFillServiceTestCases[instant]
CtsBackgroundRestrictionsTestCases[instant]
CtsCameraTestCases[instant]
CtsCarTestCases[instant]
CtsClassLoaderFactoryInMemoryDexClassLoader
TestCases[instant]
CtsClassLoaderFactoryPathClassLoaderTestCases[instant]
CtsClassloaderSplitsHostTestCases[instant]
CtsColorModeTestCases[instant]
CtsContentCaptureServiceTestCases[instant]
CtsContentTestCases[instant]
CtsDatabaseTestCases[instant]
CtsDeviceConfigTestCases[instant]
CtsDisplayTestCases[instant]
CtsDpiTestCases[instant]
CtsDreamsTestCases[instant]
CtsDrmTestCases[instant]
CtsDynamicLinkerTestCases[instant]
CtsEffectTestCases[instant]
CtsExtendedMockingTestCases[instant]
CtsFileSystemTestCases[instant]
CtsFragmentTestCasesSdk26[instant]
CtsFragmentTestCases[instant]
CtsGestureTestCases[instant]
CtsGraphicsTestCases[instant]
CtsHostsideNetworkTests[instant]
CtsHostsideWebViewTests[instant]
CtsIncidentHostTestCases[instant]
CtsInlineMockingTestCases[instant]
CtsInputMethodServiceHostTestCases[instant]
CtsInputMethodTestCases[instant]
CtsJdwpTestCases[instant]
CtsJniTestCases[instant]
CtsLocation2TestCases[instant]
CtsLocationTestCases[instant]
CtsMediaHostTestCases[instant]
CtsMediaTestCases[instant]
CtsMockingDebuggableTestCases[instant]
CtsMockingTestCases[instant]
CtsMultiUserHostTestCases[instant]
CtsMultiUserTestCases[instant]
CtsNNAPIBenchmarkTestCases[instant]
CtsNativeMediaAAudioTestCases[instant]
CtsNativeMediaSlTestCases[instant]
CtsNativeMediaXaTestCases[instant]
CtsNativeNetDnsTestCases[instant]
CtsNativeNetTestCases[instant]
CtsNdkBinderTestCases[instant]
CtsNetSecConfigAttributeTestCases[instant]
CtsNetSecConfigBasicDebugDisabled
TestCases[instant]
CtsNetSecConfigBasicDebugEnabledTestCases[instant]
CtsNetSecConfigBasicDomainConfigTestCases[instant]
CtsNetSecConfigCleartextTrafficTestCases[instant]
CtsNetSecConfigInvalidPinTestCases[instant]
CtsNetSecConfigNestedDomainConfig
TestCases[instant]
CtsNetSecConfigResourcesSrcTestCases[instant]
CtsNetTestCasesInternetPermission[instant]
CtsNetTestCasesUpdateStatsPermission[instant]
CtsNetTestCases[instant]
CtsOmapiTestCases[instant]
CtsOsHostTestCases[instant]
CtsOsTestCases[instant]
CtsPackageInstallTestCases[instant]
CtsPdfTestCases[instant]
CtsPermission2TestCases[instant]
CtsPermissionTestCases Sdk28[instant]
CtsPermissionTestCasesTelephony[instant]
CtsPermissionTestCases[instant]
CtsPreferenceTestCases[instant]
CtsPrintTestCases[instant]
CtsProtoTestCases[instant]
CtsRenderscriptTestCases[instant]
CtsSampleDeviceTestCases[instant]
CtsSeccompHostTestCases[instant]
CtsSecureElementAccessControlTestCases1[instant]
CtsSecureElementAccessControlTestCases2[instant]
CtsSecureElementAccessControlTestCases3[instant]
CtsSecurityTestCases[instant]
CtsSelinuxEphemeralTestCases[instant]
CtsSensorTestCases[instant]
CtsStatsdHostTestCases[instant]
CtsSystemUiHostTestCases[instant]
CtsSystemUiTestCases[instant]
CtsTelephony2TestCases[instant]
CtsTextTestCases[instant]
CtsToastTestCases[instant]
CtsUiAutomationTestCases[instant]
CtsUiRenderingTestCases27[instant]
CtsUiRenderingTestCases[instant]
CtsUidIsolationTestCases[instant]
CtsUsageStatsTestCases[instant]
CtsUsbTests[instant]
CtsUtilTestCases[instant]
CtsViewInspectorAnnotationProcessorTestCases[instant]
CtsViewTestCasesSdk28[instant]
CtsVoiceInteractionTestCases[instant]
CtsVoiceSettingsTestCases[instant]
CtsWebkitTestCases[instant]
CtsWidgetTestCases[instant]
CtsWifiBroadcastsHostTestCases[instant]
signed-CtsSecureElementAccessControlTestCases1[instant]
signed-CtsSecureElementAccessControlTestCases2[instant]
signed-CtsSecureElementAccessControlTestCases3[instant]

The table below describes the CTS Verifier modules QP1A.190627.001 (CTS Q 06/27 build vs. CTS 9.0_r8).

Audio
MIDI Test
Native MIDI API Test
Pro Audio Test
Camera
Camera Performance
Managed Provisioning - BYOD Managed Provisioning
Personal ringtones
Non-market app installation restrictions
Non-market app installation restrictions - Disable non-market apps
Non-market app installation restrictions - Enable non-market apps
Non-market app installation restrictions - Disable non-market apps (global restriction)
Non-market app installation restrictions - Enable non-market apps (global restriction)
Disable primary user non-market apps (global restriction)
Enable primary user non-market apps (global restriction)
Confilm pattern lock test
Uninstall work app from launcher
Managed Provisioning - Device Owner Tests
Policy transparency test - Disallow config date time
Policy transparency test - Disallow config screen timeout
Policy transparency test - Disallow config brightness
Managed User - Policy transparency test - Disallow config date time
Managed User - Policy transparency test - Disallow config screen timeout
Managed User - Policy transparency test - Disallow config brightness
Customize Lock Screen message
Networking - Bluetooth Test
Bluetooth LE CoC Insecure Client Test - 01 Bluetooth LE CoC Client Test
Bluetooth LE CoC Insecure Server Test - 01 Bluetooth LE CoC Server Test
Bluetooth LE CoC Secure Client Test - 01 Bluetooth LE CoC Client Test
Bluetooth LE CoC Secure Server Test - 01 Bluetooth LE CoC Server Test
Networking - Wi-Fi Direct Test
Group Owner With Config Test
Group Client With Config Test - Join p2p group test (config)
Group Owner With Config 2G Band Test
Group Client With Config 2G Band Test - Join p2p group test (2.4G config)
Group Owner With Config Fixed Frequency Test
Group Client With Config Fixed Frequency Test - Join p2p group test (2447 MHz config)
Networking - Wi-Fi Test
Network Request with a specific SSID and BSSID
Network Request with a SSID and BSSID pattern
Network Request with a specific network that is unavailable
Network suggestion with SSID
Network suggestion with SSID and BSSID
Network suggestion with SSID and post connection broadcast
Notifications
Bubble Notification Tests
Other
Recent Task Removal Test
Security
Biometric Prompt Bound Keys Test
Biometric Test
Set New Password Complexity Test
Step Permission Test
Titles
Tile Service Test