Early Access / Project Stovetop: Hardware accelerated ToF 3d fusion smart camera

Style

By special request: Advance preview of the Project Stovetop 3d fusion smart camera system.  Available for customization.

Options for discussion includes selecting time of flight sensor:

 MTP006 (HQVGA) or OZT-358 (VGA)

Single unit includes:

  • Project Stovetop ToF Fusion USB 3.1 Peripheral.
  • Black Multi Jet Fusion Enclosure in PA12 Nylon
  • Fully assembly and calibrated *
  • 6' USB 3.1 Type-A to Type-C Cable

Features:

  • Docker based runtime
  • Options for running depth pipeline on device and on host
  • Onboard processing capable of 30fps delivery:
    • Depthmap
    • RGB Registered depthmap
    • RGB - XYZ dense pointclouds; pre-processed for ROS
  • Robust ROS1 Integration
    • All available data streams
    • Meant to be used with current off the shelf ROS tools
  • ROS2 Integration basic functionality
  • Support for rqt_reconfigure
  • Proprietary ML based filtering available to Increases effective range, decreases noise, fills holes
  • Support for up to 4 imagers
    • 1x ToF currently support, support for multiple ToF sensor planned H2-2022
  • Cameras with stereo pairs can also output:
    • Stereo depth
    • Disparity
    • Recitified / registered depth
  • MyriadX firmware can be customized if needed for additional capabilities/optimization
  • Proprietary camera calibration tools for both single and multi camera systems
  • Multi-camera management tools
  • Multi-camera reconstruction. Runs at framerate on most GPUs

 

Calibration notes:

Color/depth registration for Auto-focus modules (Sony IMX 378) is experimental and considered a work in progress.  If fusion registration is critical, we recommend selecting a version of with Fixed focus (OV9x82) to ensure the most accurate and consistent depth registration.

We aren't currently distributing an end-user calibration utility for the preview units.  During the manufacturing process, we capture and retain multiple calibration data set specifically to facilitate future/remote updates of calibration model(s) as our processes improve.  If units are disassembled, we may not be able to provide useful field updates and don't recommend separating the imagers from their mount

Subscribe