Matrix Eyes

Matrix Eyes is a weekend project to convert a photo image into an autostereogram.

Using the MiDaS depth estimation algorithm.

Instructions

Installation

pip install -r requirements.txt

Usage

To use a custom Torch home directory, set the TORCH_HOME environment variable.

To gerate a depth image, run:

python main.py [--model-type=DPT_Large|DPT_Hybrid|MiDaS_small] [--output-format=image|stereogram|mesh] [--stereo-amplitude=<value>] <input file> <output_file>

replacing <input file> with the source image filename, and <output file> with the output destination filename.

Additional (optional) arguments:

• model-type specifies one of the MiDaS models
  • DPT_Large will use MiDaS v3 - Large (highest accuracy, slowest inference speed); default
  • DPT_Hybrid will use MiDaS v3 - Hybrid (medium accuracy, medium inference speed)
  • MiDaS_small will use MiDaS v2.1 - Small (lowest accuracy, highest inference speed)
• output-format specifies what to output
  • image will output a depth map image; default
  • stereogram will output a stereogram image
  • mesh will output a 3D Wavefront OBJ file
• stereo-amplitude specifies the maximuim offset/depth for stereograms (relative to image width); might need to be reduced if most of the image consists of foreground objects

Examples

Image 1

Source image:

Depth data extracted by MiDaS:

Generated stereogram - works best when viewed in fullscreen: