Overview
Description
The 3D Gesture Reference Design is a solution that can detect the position (x, y and z coordinates) of a hand in space using Renesas' capacitive touch solution. The position of a hand up to 200mm above a panel surface is converted to x, y and z coordinates. Moreover, since sensing of coordinate data can be carried out at high speed, gestures (up and down, right and left, and front and behind) and simple pattern recognition can be used to operate a device.
This Reference Design is a solution combines multiple capacitive proximity sensors to detect hand gestures such as holding for a certain period of time or moving a hand over from the electrode to other electrode for realizing simplified gesture operations.
Features
- Based on Renesas' high sensitivity, noise-tolerant capacitive touch solution
- Recognize the position of a hand up to 200mm above a sensor
- Up to 1mm accuracy
- High noise tolerance and works with shielding
- Sensing can be carried out with any nonconducting material - thus can be embedded inside a wall, etc.
- Realize system control and gesture operation for your product using a high-performance, low power 32-bit microcontroller and touch IP
- Also possible to use gestures in combination with touch buttons
- Support for IEC 61000 4-3 Level3
Can gesture recognition be used with infrared (pyroelectric sensor), sound wave devices, or cameras?
Suggested Touch-Free User Interfaces
Hardware Configuration
e-AI x 3D gesture recognition
You can develop a gesture application that reacts "by anyone's hand" without any specialized skills just by actually performing the gesture that you want AI to remember on the capacitance sensor.
e-AI × 3D Gesture Recognition >>
Usage Example of e-AI × 3D gesture recognition feature >>
Hardware Information
| Reference Design | Application Notes | Gerber Data |
|---|---|---|
| 3D Standard Version (160mm) RX231 | 3D Gesture Demo Set (Hardware) (Standard version) Rev.1.00 (PDF | English, 日本語) | 3D Gesture Reference Design Standard Version Gerber Data (ZIP | English, 日本語) |
| 3D Small Version (80mm) RX130 | 3D Gesture Demo Set Small version (Hardware) Rev.1.00 (PDF | English, 日本語) | 3D Gesture Reference Design Small Version Gerber Data (ZIP | English, 日本語) |
| 3D Slim Version (100mm) RX130 | 3D Gesture Demo Set Slim version (Hardware) Rev.1.00 (PDF | English, 日本語) | 3D Gesture Reference Design Slim Version Gerber Data (ZIP | English, 日本語) |
| 2D Gesture (300*50mm) RX130 | 2D Gesture Solution Demo Set Hardware Rev.1.00 (PDF) | 2D Gesture Reference Design Gerber Data (ZIP | English, 日本語) |
| 3D Gesture Electrode Board | 3D Gesture Electrode Board (Hardware) (PDF | English, 日本語) | CTSU 3D Gesture Electrode Board Reference Design Gerber Data (ZIP) |
Software Configuration
| Firmware | Contents | Code Size |
|---|---|---|
| 3D Standard version (160mm) RX231 CTSU 3D Gesture Demo Set Sample Software (Standard version) - Sample Code (ZIP | English, 日本語) | Gesture recognition binary code Coordinate detection middleware Touch API | ROM: 34.2 KB RAM: 5.8 KB |
| 3D Small version (80mm) RX130 CTSU 3D Gesture Demo Set Sample Software (Small version) - Sample Code (ZIP | English, 日本語) | Gesture recognition binary code Coordinate detection middleware Touch API | ROM: 27.4 KB RAM: 4.8 KB |
| 3D Slim version (100mm) RX130 CTSU 3D Gesture Demo Set Sample Software (Slim version) - Sample Code (ZIP | English, 日本語) | Gesture recognition binary code Coordinate detection middleware Touch API | ROM: 27.3 KB RAM: 4.9 KB |
| 2D Gesture (300*50mm) RX130 CTSU 2D Gesture Reference Design Demo Set Sample Software - Sample Code (ZIP | English, 日本語) | Sample Program Touch API | ROM: 38.8 KB RAM: 3.8 KB |
| 3D Gesture Electrode Board RA2L1 Group 3D Gesture Electrode Board Sample Software (PDF | English, 日本語) | Sample Program | ROM: 31.2 KB RAM: 5.4 KB |
*Gesture recognition, coordinate detection middleware is the same except electrode placement, USB presence/absence etc.
| PC Software | Contents | Code Size |
|---|---|---|
| 3D Monitor Tool CTSU 3D Gesture Demo Set Evaluation Tool '3D Monitor' Rev.1.00 - Sample Code (ZIP | English, 日本語) Three-dimensional coordinates, gesture motion, electrode sensitivity, etc. can be evaluated | Executable EXE file | — |
| 2D Monitor Tool CTSU 2D Gesture reference Design Evaluation Tool '2D Monitor' Rev.1.00 - Sample Code (ZIP | English, 日本語) Simplified gesture operation, electrode sensitivity, etc. can be evaluated. | Executable EXE file | — |
Applications
Documentation
|
|
|
|
|---|---|---|
| Type | Title | Date |
| Application Note | PDF 522 KB 日本語 | |
| Application Note | PDF 4.53 MB 日本語 | |
| Application Note | PDF 440 KB 日本語 | |
| Application Note | PDF 435 KB 日本語 | |
| Application Note | PDF 1.42 MB 日本語 | |
| Application Note | PDF 979 KB 日本語 | |
| Application Note | PDF 842 KB 日本語 | |
| Application Note | PDF 3.91 MB 日本語 | |
8 items
|
||
Design & Development
Software & Tools
Software Downloads
|
|
|
|
|---|---|---|
| Type | Title | Date |
| Software & Tools - Other | ZIP 341 KB | |
| Software & Tools - Other | ZIP 106 KB 日本語 | |
| Software & Tools - Other | ZIP 46 KB 日本語 | |
| Software & Tools - Other | ZIP 194 KB 日本語 | |
| Software & Tools - Other | ZIP 474 KB 日本語 | |
| Software & Tools - Other | ZIP 894 KB 日本語 | |
| Software & Tools - Other | ZIP 1.04 MB 日本語 | |
7 items
|
||
Sample Code
Lab on the Cloud
Lab on the Cloud
This solution demonstrates multiple capacitive proximity sensors used to detect hand gestures using a robotic arm. Up, Down, Right, Left, and Tap gestures can be tried by users.