This subpage describes in detail and methodically what assumptions should be met to prepare the camera to work with the Motioncube interactive floor. Although a thorough analysis of the principles presented here is not required, it can make it much easier to understand how and why an interactive floor effect is possible and what issues in particular are relevant.
All the requirements described below are met by Motioncube IR-Kit.
However, you can choose a different vision technology to prepare your interactive floor using Motioncube software.
Two key requirements for the camera that will be used for the Motioncube interactive floor:
- The camera should not see what the projector is displaying.
- The camera should see what is happening on the floor surface in the projection area, regardless of the lighting conditions, such as time of day, etc.
- Ad. 1 - The camera cannot see what the projector displays, as this could lead to a situation where animations displayed on the floor would trigger a motion detector, i.e. an algorithm that detects movement in the image from the camera. Due to the fact that the projector displays the image using light from the visible spectrum, it is enough to block the possibility of observing light from this range by the camera. Another solution is to use depth cameras, where the image reflects the distance from the camera. However, these types of cameras are not optimal for all applications and should be used for specific applications (more on depth camera recommendations)
How to check it?To verify that the above requirement is met, point the camera towards the image projected by the projector. Then check if you can see a uniform area on the preview image from the camera - the camera should not see the image displayed by the projector. You can perform the tests using any camera program.
- Ad. 2 - From the point of view of the camera, external lighting conditions should not matter. For the camera, the interaction area should always be uniform, regardless of lighting conditions.
- For motion interaction, the camera should see the projection area as uniform and bright so that even at night or in a dark room, the camera can see what is happening in the interaction area. To meet this requirement, you will probably need to additionally illuminate the interaction area using an external or integrated with the camera infrared light source (read more about IR illuminators). In the case of depth cameras, additional IR illumination is not required, because such cameras have built-in light sources that ensure their ability to work even at night.
- For interaction with IR pens, the camera should see the projection area as uniform and dark for the Motioncube light point detector to work properly. Additional IR illumination for interaction with IR pens is not applicable.
How to check it?Do the tests in a heavily darkened room or just wait until dark to test. The equipment you want to use should ensure that the camera can see light even when the room is dark. Remember that the light from the projector will not be visible to the camera (see Ad.1 above), so you can't count on lighting with this light.
Before you start working with the Motioncube software, make sure that you have access to the video signal for the selected camera from the level of other applications (optimally system applications, and not necessarily the camera manufacturer's software, which may have proprietary image transfer mechanisms).
Recommended test programs:
- Windows 10 -
Windows Camera(view in Windows Store).
- Linux Ubuntu 20.04 or 22.04 -
guvcview(available in the package repository).
- You can also test using a web browser by visiting https://webcamtests.com/.
SimplifiedIf the video signal is available in other programs, it will probably also be available in Motioncube. If it is not available in other programs, there is a small chance that it will be available in Motioncube. Check it out so that you can quickly identify the problem in case of problems.
Support for various ways to interact with the app
Below is a summary of requirements for cameras and additional accessories for preparing an interactive floor with Motioncube software with support for selected interaction techniques.
We present here only general requirements without detailed discussion. Details can be found on the indicated subpages of our documentation.
A. All interaction techniques
Use the Motioncube IR-Kit module, which fully supports all ways of interacting with applications and provides perfect precision and also enables automatic calibration of interactive modules.
You need a camera that can capture movement regardless of lighting conditions.
Working with 2D cameras (recommended)
If you use CCTV technology (using analog cameras as an example) you will need the following items:
- CCTV camera with integrated illuminator,
- USB grabber,
- power adapter to power the camera,
- signal-power cable, or two separate cables (one for video transmission and the other for power supply, if the cable from the power supply is too short),
- filter blocking visible light,
- mechanical dusk sensor blockade (if the camera does not have a manual night mode force),
- additional connectors to connect the signal cable to the USB grabber.
See guide how to put it all together (under development) and use with Motioncube software.
For classic USB cameras the following are required:
- USB board camera,
- lens without IR light blocking filter,
- mounted on the lens filter blocking visible light,
- additional source of infrared light, the so-called IR illuminator.
Working with depth cameras (optional)
- Intel RealSense depth camera is enough - no additional accessories required.
- However, these cameras have their limitations (described in this section) which may make the area of application and experience of using the floor interactive will turn out to be lower than in the case of using classic 2D cameras.
You need a camera that can record the IR light source emitted by IR light pens.
- Use a 2D camera without additional IR lighting.
- Intel RealSense depth cameras are not supported by the Motioncube software for this type of interaction.
You need a camera that meets the requirements for Motion-interaction.
Remember!Using a kit other than Motioncube IR-Kit (e.g. classic USB cameras or depth cameras indicated above) it requires manual calibration of the projection area and does not allow for automatic switching of application interaction from IR pen control to motion interaction and vice versa.