Hand motion tracking based on gesture understanding using leap gesture for virtual 3D batik gallery

Open

A.C. Padmasari, M. Hariadi, C. Christyowidiasmoro

2020 Journal of Physics: Conference Series Vol. 1469 Issue 1 Conference paper Cited by 1 SDG 9 Quartile

Abstract

Virtual batik 3D gallery is designed as one of the efforts utilizations of digital-based on media for Industrial Revolution 4.0 where the flow of globalization is becoming sophisticated which emphasizes the digital economical pattern, artificial intelligence, big data, robotic. This research emphasizes on hand motion tracking based scientific knowledge on Gesture Understanding using Leap gesture for the 3-Dimensional Virtual Batik Gallery. Gesture-understanding based on Hand Motion Tracking which advocates Leap Gesture for a 3D Virtual Batik Gallery functions as an interactive virtual media replacing part of the functions Keyboard and Mouse process. This is aimed at varying the media packaging, especially for information providers in terms of how they can relay the information quickly to others, designing application, or documenting data. The method used in this research is Design and Development (D&D) and required three steps involving the process of modelling the initial design (3D modelling) using Normal Map technique, the process of making gesture scenario in the form of FSM in every room, and gesture design using hand motion tracking in Leap Motion controller. The result of the study was in the forms of responses to hand motion tracking in a 3D batik gallery, which was grouped into 3 hand-gesture-understanding concepts: Tap Gesture with motion response description for GPU (16 mm/s 60 FPS), (10 mm / s 100 FPS), (5 ms/200 FPS), CPU (33 ms 30FPS), and (16 ms / 60 FPS); for describing and detecting Flyhand Gesture on GPU (16 mm/s) (60 FPS10 mm / s) (100 FPS5 m/s 200 FPS) on CPU (33 ms/30FPS) (16 ms / 60 FPS); for Trusther in (GPU = 16 mm/s) (60 FPS33mm / s) (100 FPS 16 ms / 60 FPS) CPU (33 ms 30 FPS 10 ms) (60 FPS 33 ms 5 ms 200 FPS); and for Hold Hand Gesture on CPU (33 ms 30 FPS) (66 ms 60 FPS) and the response on GPU (33 ms 30 FPS) (66 ms 60 FPS). © 2020 Published under licence by IOP Publishing Ltd.

Affiliations

Universitas Pendidikan Indonesia, Bandung, Indonesia; Multimedia Networks Department, Sepuluh November Institute of Technology, Surabaya, Indonesia

Research at a Glance

Premium content — register to unlock

Research at a Glance

Register to unlock

Topics & SDG Alignment

Premium content — register to unlock

Topics & SDG Alignment

Register to unlock

Collaboration

Premium content — register to unlock

Collaboration

Register to unlock

Author Profile (Selected)

Premium content — register to unlock

Author Profile (Selected)

Register to unlock

References Overview

Premium content — register to unlock

References Overview

Register to unlock

Journal & Source

Premium content — register to unlock

Journal & Source

Register to unlock

Metadata & Integrity

Premium content — register to unlock

Metadata & Integrity

Register to unlock