Skip to main content

e-AI × 3D Gesture Recognition - QE for Capacitive Touch

QE for Capacitive Touch: Development Assistance Tool for Capacitive Touch Sensors

The “3D gesture recognition” feature of QE for Capacitive Touch supports the development of gesture applications with the use of AI. Though the development of AI applications involves many processes and a high level of difficulty, three features of the QE tool support development, allowing anyone to develop AI applications without the need for specialized AI skills.

Image


3 features that enable "3D gesture recognition"

1. Recording

Gesture data can be registered just by actually performing the gesture that you want the AI to recognize on the capacitive sensor.
The registered data are displayed in a list supporting the deletion of data from failed gestures and an importing feature.

Image
recording1200-r2-en

2. AI generation

During the processes of creating the AI (data pre-processing, deep learning, and conversion to C source code), the QE tool automatically proceeds with optimum processing for gestures. Although automating AI creation is usually difficult, this can be achieved by focusing the target on the gesture.

Image
QE aoutomatically processes

3. Monitoring & Tuning

You can monitor and tune the precision of the created AI on the actual machine. If a gesture has not been correctly recognized, you can immediately add the waveform to the training data by clicking on the [Add Data] button on the monitoring screen to give feedback to the AI.
This eases proceeding with iterations to improve the AI engine.

Image
3D gesture monitoring-tuning

The three features above realize the development of free gesture applications that react to the gestures by anyone’s hands without the need for specialized AI skills.

Related Documentation & Downloads

The 3D gesture recognition feature of QE for Capacitive Touch is an extended facility of the e2 studio integrated development environment from Renesas.
This feature is realized in combination with the touch-free user interface by using Renesas' capacitive touch key solution and the e-AI solution.
For more details and downloading the software, see the following product information pages.
・e² studio
・QE for Capacitive Touch
・Capacitive Touch Sensor Solutions
・e-AI Solution

Videos

3D Gesture AI Solution - QE for Capacitive Touch Makes It Easy To Develop a Contactless User Interface

In this video, we will show you how to develop a 3D gesture AI solution using QE for Capacitive Touch. You can easily develop a 3D gesture recognition function by just following the workflow.