How does an intelligent camera recognize transparent and reflective objects? SingTown Technology OpenMV solves competition challenges

In robot competitions, vehicles or robotic arms often need to identify the position of target objects in complex backgrounds to accomplish path planning or picking tasks.

This project requires the identification of targets which are translucent acrylic hemispherical covers, approximately 10 centimeters in diameter, with a 2-centimeter border at the base. They are positioned centrally on the indoor floor within a 4x4 meter area. There can be a maximum of three targets, and their locations are fixed.

The background is a non-solid color floor with simple patterns, prone to reflections and lighting interference.

To achieve precise coordinate recognition and pose estimation, the team plans to use SingTown's OpenMV intelligent camera as the vehicle's vision module for real-time detection and positioning of the acrylic cover.

The system must output the central point information of the target in the image coordinate system and transmit the data to the small vehicle's main control system to achieve automatic navigation, path adjustment, or task triggering.

The robotics competition project utilizes a transparent target detection system built upon SingTown Technology's OpenMV intelligent camera. Its computer vision and image recognition technology, through the integration of reflective feature detection, edge extraction, and morphological analysis algorithms, enables precise identification of semi-transparent acrylic covers under complex lighting conditions.

Due to the strong reflectivity and weak edge contours of acrylic material, the system first employs dynamic thresholding and background adaptive algorithms to suppress interference from ground patterns. It then uses Sobel edge detection and morphological closing operations to extract the edge contours of transparent acrylic. To address reflections, the system utilizes brightness distribution and highlight detection, effectively distinguishing real boundaries from specular reflections.

After identification is complete, the program automatically calculates the centroid coordinates (x, y) of the acrylic cover within the camera's field of view and outputs them to the main control board of the SingTown car via the serial port.

When detecting multiple targets, the algorithm can filter based on target area or position, identifying the cover body within the central area of the site as the primary target.

Practical tests show that this solution achieves a recognition success rate of over 93% in indoor environments with uniform lighting, with a positional error of less than 1.5 centimeters (with the camera positioned 30 centimeters above the ground).

SingTown Technology OpenMV embedded vision system operates at high speed (frame rate above 20fps), suitable for scenarios requiring edge deployment such as robotics competitions, vehicle navigation, and robotic arm grasping.

Its advantage lies in not requiring markers, having strong adaptability to transparent bodies, and being able to stably output coordinate signals under different ground patterns, providing precise visual input for automatic control systems.