Interactive Projection Setup

Depth Calibration > Quick Setup

Calibration flow

To calibrate selected depth sensor to work in an interactive projection environment (floor, wall or table), the following steps are required:

  1. Setting the image orientation (vertical/horizontal).
  2. Setting the interaction area corners (calibration points).
  3. Setting the detection parameters (technique, tilt, distance and sensitivity).

The camera calibration process will be described in detail in next sections.

Note

Although this guide uses the interactive floor as an example, the calibration process is identical for the wall and table setups. Just select the environment you are configuring (wall or table) at the corresponding steps instead of floor.

Before we start the calibration, pre-configuration of the Player is required to define your target work environment.

Download and install Motioncube Beam

Please go to https://pro.motioncube.io/download web page and download Motioncube Beam version. Install it. This version includes all the options you need for interactive projection.

Player Startup: Environment Selection

1. Choose INTERACTIVE PROJECTION at startup

When you start the Player for the first time, you will see a screen to select the Player environment. If you have installed Motioncube Beam, no action is required. If you have installed Motioncube Full, select Interactive Projection (even if your setup includes only a PC and a camera, without a projector). If you choose another option, you will not be guided through the Interactive Projection Wizard, but will see an interface adapted for different interactive devices (e.g., touch screens).

image

ACTION Choose Interactive Projection option.

2. Define CAMERA TYPE as DEPTH CAMERA

Select one camera type of these shown below:

  1. Depth camera
  2. IR USB camera board
  3. Motioncube IR Kit

ACTION Select a Depth camera option.

image

Next screens will be adjusted to your choice.

3a. Select INTERACTIVE FLOOR as a projection SURFACE

Choose the surfaces on which interactive games will be projected. You may combine even two or three surfaces, depending of your setup capabilities. Typically Floor mode and Table mode can be combined in one setup easily, as the projection area is horizontal in both modes and there may be no need to ingerate in the installation.

ACTION Select Interactive Floor

image

3b. Choose MOTION INTERACTION type

Motion interaction is a standard way of playing apps on the interactive floor. We offer within motion-interactive setups additional interesting forms of playing the games like steering the RC vehicle or contolling games from a mobile UI (i.e. with smartphone). You can leave only Motion interaction checkbox checked, or select all visible. The consequence of checking specific interaction types will be the visibility of specific games in Your App Library; you will see only those apps for which interaction type was selected in this view. You can always change your selection later by reopening this view in Menu: Settings > Advanced > Player Environment & Modes.

ACTION Select Motion interaction and Apply

Great! The Player has all the basic settings defined. Next step will be just to indicate the camera for your setup and calibrate the interaction area. The Interactive Projection Wizard will guide you through this process.

Finally click YES on the Interactive Projection Wizard popup.

Interactive Projection Wizard

Once you have your Player configured to work in the interactive projection environment, you may go through camera setting and calibration flow.

image

Now you should have a depth camera connected with your computer. Make sure your Windows operating system detects your camera. Install necessary drivers or runtimes. In case of any problem see Troubleshooting Guide.

Connect the projector with a computer. Face both devices onto one surface area. Camera view shall cover entire image (plus some margin) in the projection area. Switch main display to a projector to enable calibration on a target projection surface. For more details see Your first interactive floor guide.

Useful option

At this phase, for testing purposes only, it is not a must to have a projector connected to your computer, as you can follow the whole calibration process and display games on your monitor. However, to calibrate the camera for the desired setup with the image projected on a surface the projector is necessary.

1. Setup Selection

Choose your basic device mode: Floor, Table or Wall. Calibration options will be adjusted to your selection.

ACTION Select Floor

image

2. Stream Engines Selection

Choose from the list the required stream engine(s) for your setup. Do not set all possibilities by default, if it is not necessary, as this impact on Player workload.

ACTION Choose the engine for your target depth camera

image

3. Frame Source Selection

From a Device list select your camera device. If you don't see any camera or you can't see the view from the camera, see Troubleshooting Guide.

ACTION Select your depth sensor model

image

4. Image Orientation

First step: Make sure the orientation of the image displayed by the projector is correct. In case of the floor projection the players shall see the image correctly while facing the projector, not having projector on their backs. Correct projector settings for image if needed.

Second step: Stand in the interaction area and verify the view in the camera. Make flips with the image in the camera view, only if the user orientation is captured wrong.

ACTION Flip the camera image horizontally or vertically if required.

image

5. Determine the Camera Calibration Points

In this step we use the RGB preview from the camera to define four corners of the projected image.

ACTION Move four calibration points with a mouse and set the interaction area. The camera shall see exactly the game area/game image - not less, not more.

image

6. Motion Detection Technique

Motioncube offers four detection modes for detecting motion and the position of stationary objects using depth sensors.

image

Here you can find instructions on how to select the appropriate detection mode for your installation conditions and intended use:

ACTION Choose Wide Range mode

7. Surface Tilt Adjustment

This step makes the surface even in the camera view, by recalculating distances between camera and surface in the interaction area.

Apply this step for each detection modes.

ACTION Run Auto adjustment, then correct manually if needed

image

8. Set the distance range for motion detection

Apply this step for each detection modes.

ACTION Run Auto adjustment. Correct manually if needed for Single Frame mode. For Diff Frame leave automatic settings.

Verify your settings by moving near the surface (e.g., walking on the floor) and observing the camera view.

image

9. Sensitivity for Motion Detection

Threshold parameter defines which motion detection results will trigger interaction effect. The lower the value, the more detection rubbish. The higher the value, the smaller detection results. During this process, do not enter the interaction area.

The default value for floor, table, and wall will be calculated automatically. You can keep the suggested value or adjust it if needed.

Verify your settings by moving near the surface and observing the camera view.

image

10. Done! What's next?

Use the Motioncube Interactive Showcase collection (from Motioncube Store) of free apps to test your interactive installation.

You can read more how to perform tests on the Depth Calibration > Quick Testing subpage.