In this article I’ll discuss multiple ways to localize an ellipse in an image.
“DUAL CONIC” method
This method is from Hebert09. I think it’s akin to the “opencv” checker localization algorithm in that it’s a linear algorithm that operates on the image gradients.
Anyway, to understand this method, you need to understand what a conic section is. A conic section is a curve obtained as the intersection of the surface of a cone with a plane. The possible conic sections are a hyperbola, parabola, and ellipse. It turns out that a conic can be represented as a matrix:
and points, represented in homogeneous coordinates as , lie on the conic if:
Continue reading “Ellipse Detection/Localization”
In this article I’ll discuss multiple ways to localize a checker in an image.
The opencv method is the defacto standard for checker localization. It’s fast, robust, accurate and is the checker localization algorithm used in Bouguet’s camera calibration toolbox. It is based on the observation that a vector with its tail at the center of a checker and the tip in a region around a checker should always have a zero dot product with the intensity gradient located at the tip of the vector:
Note that the example figures in this section are for a corner, but the same holds for a checker. Anyway:
- in “flat” regions:
- in edge regions:
Continue reading “Checker Detection/Localization”
Single Camera Model
We assume the camera adheres to the “pin-hole” model, where points in space project as straight lines to the camera aperture (the origin of the “scene” coordinate system) and intersect through an image plane at “image points”. This image plane is supposed to represent the ideal physical location of the image sensor, and contains a 2D projection of 3D scene points.
The diagram below describes the model:
Continue reading “Camera Calibration Theory”
In this article, I’m going to calibrate a multi camera setup and I’m going to do it in a way that’s automated and reproducible.
Tools and files used in this article:
First, install the camera_calib toolbox:
git clone https://github.com/justinblaber/camera_calib.git ~/camera_calib
Next, download the example data (warning: very large file…):
mkdir -p ~/Desktop/multi_camera_calib
Continue reading “Multiple Camera Calibration”
In the previous article, I set up a multi-camera rig with Flir Blackfly S cameras and a hardware trigger setup. The next step is to configure the cameras via spinnaker API so that the synchronized capture works correctly.
The first section gives a very basic example of how to acquire a set of synchronized images using the PySpin API. The section after that describes how to use the multi_pyspin app to collect images.
A simple PySpin example
The first thing to do is to download and install the Spinnaker SDK and python package. In this article, I’ll be using Ubuntu 18.04 with Spinnaker version 18.104.22.168 and 1804.0.113.3 firmware version.
The documentation for synchronized capture for the Blackfly S states you must:
Continue reading “Acquiring Synchronized Multiple Camera Images with Spinnaker Python API + Hardware Trigger”
- For the primary camera: 1) enable the 3.3V output for line 2
- For each secondary camera: 1) set the trigger source to line 3, 2) set the trigger overlap to “read out”, and 3) then set trigger mode to “on”.
I decided to go with Flir Blackfly S IMX252 Mono USB3 vision cameras; I choose them because they offer a good overall balance between image quality, resolution, price, and they use Flir’s Spinnaker SDK.
The setup I’m using for synchronized capture is a primary/secondary setup. One camera (in my case, the left-most camera) is set as the “primary” camera. This camera sends out a strobe signal when it begins exposure of an image to the secondary camera(s) to trigger them to acquire images at the same(ish) time.
Continue reading “Multiple Camera Setup with Blackfly S Mono USB3 Vision Cameras”