User Testing Results

Installation setup for user testing

Some of the user testing participants

Observation Results

Installation setup for observation

Observation participants

Design Experiments 2: Kinect with Unity

Experiment 7: Kinect with Unity

In this experiment, I tried to access the depth data in Unity measured by the Kinect using Kinect v2 plugin for unity.

Processing to Unity

The initial idea for this project was to make an interactive educational game with physical balls as the game control to triggers a digital reaction. This idea bridges the gap between real physical and virtual world. The mechanism was for the player to throw the physical balls “into” a virtual scene projected on a wall. The technologies that have been used were Microsoft Kinect for Windows v2 and InFocus X6 projector. The front-end design was created using Adobe Illustrator, in which would be programmed using Processing.

Unity

Unity becomes one of the most popular and used by game developers as it provides a very reliable engine for both 2D and 3D cross-platform game development. You can export games for PC, Mac, Android, iOS, Windows Phone, Blackberry, PS3, XBOX with ease. It supports 3 programming languages: C#, UnityScript, and Boo. Although UnityScript sounds like it is the main language, the widely adopted language is C# (Wilcox, 2014).

Design Experiments: Kinect with Processing #3

Physical ball

This experiment is an infusion of  Geometric Fireworks and Particle System. The experiment was executed by calibrating the wall to define the intended depth value that would trigger the Geometric Fireworks, which is basically changing the cursor into a physical thing. The experiment was a success but sadly, for whatever reasons, errors start appearing and debugging takes a very long time.

Design Experiments: Kinect with Processing #2

Experiment 5: Particle System

This experiment was to calibrate minimum and maximum depth threshold by activating only the raw depth data between those values. The particle system will be activated when the user is detected within the depth value.

Source: https://www.youtube.com/watch?v=Kr4s5sLoROY

Design Experiments: Kinect with Processing #1

As mentioned before, Processing provides the library for both Kinect v1 and v2. So I used the Kinect v2 library that provides examples such as the following figures showing face recognition, depth, skeleton, and point cloud.

Design Experiments: Processing

Experiment 1: Particles Simulate Fluid

This experiment applied Math and Physics logic that was difficult to understand. Thus I downloaded the project file to analyze and comprehend the mechanism before I did a hands-on experiment myself and re-create the project.

Code: https://www.openprocessing.org/sketch/160764
Source: https://www.youtube.com/watch?v=4NU37rPOAsk

Processing

Processing is a simplified open source programming language which is suitable for interactive graphics programming. Processing is more focused on the graphic and interaction rather than data structure (Wardana, 2015). It is free to download for Linux, Mac OS X, and Windows. It comes with excellent documentation and a large library of extensions, examples, and demos.