TV Application Development with Gesture Control

Project in Nutshell: commissioned by a German TV manufacturer, we developed an Android TV app to control smart TVs with gestures. Offering a range of functionalities, including streaming, web browsing, and gaming, the distinctive feature of this AI-powered app lies in real-time gesture recognition.  

Client & Challenge  

A TV manufacturing company from Germany approached us to develop an Android TV application for childcare centres. The solution had to be equipped with edge AI technology to allow users to control their smart TV with gestures.

 

Solution

We designed the Android-based TV application to enhance user interaction with their smart TV devices. It offers a variety of functionalites, including streaming content, browsing, and gaming. The standout feature is gesture recognition:

Gesture recognition
  1. Pinching and stretching to change the picture’s size.
  2. A tap to select or confirm choices within the application.
  3. Swiping gestures are used to move between different screens or options.

Our client also received the following features in the new application:

  • Real-time gesture recognition thanks to the advanced chips in Smart TVs.
  • Security and privacy. Gesture data is processed locally, enhancing user privacy by eliminating the need for cloud-based data transmission.
  • Updates and expansions. The application allows over-the-air updates to enhance gesture recognition accuracy and introduce new features over time. 

The application requires a smart TV with a camera and a powerful processor for local video processing. We chose the Amlogic A311D SoC designed for various applications, including smart TVs with gesture control. This system-on-a-chip features a quad-core ARM Cortex-A73 processor and a dual-core Cortex-A53 processor for multitasking and efficient power management. Our client plans to release a line of smart TVs with this chip and an embedded video camera. 

 

Business Value  

The creation of this Android-based TV application, featuring artificial intelligence and gesture recognition technology, expands the company's current product lineup and offers competitive benefits.  

The application is especially relevant for places where hygiene is critical. This app was commissioned for the needs of childcare centres but can be used in other places as well, such as: 

  • Hospitals and healthcare facilities to reduce the risk of germ transmission in patient rooms, waiting areas, and shared spaces.
  • Airports and high-traffic areas to minimise the spread of viruses through shared remote controls in public lounges.
  • Hotels and hospitality to provide a cleaner and more sanitary option for guests.
  • Restaurants allow visitors to interact with screens without touching potentially contaminated surfaces.
  • Fitness centres and gyms to ensure cleanliness and reduce the need for members to touch remotes while exercising.
  • Educational institutions reduce the risk of cross-contamination among students and faculty, especially in shared spaces like libraries and classrooms.
  • Public transportation. Buses, trains, and subways can implement gesture control applications for in-vehicle entertainment systems to minimise physical contact and promote a better sanitary experience for passengers.
  • Shopping malls. Gesture control can be integrated into digital signage and info kiosks in malls and stores to provide a safer way for shoppers to access information.
  • Conference and meeting rooms to enhance the interaction and collaboration experience while also reducing the risk of contamination.
  • Automotive applications. Gesture control in In-Vehicle Infotainment (IVI) systems offers a hands-free and intuitive way for drivers and passengers to interact with various features. 

Other Case Studies

Tell us about your project!

All submitted information will be kept confidential.