Volume Measurement of Biological Materials in Livestock or Vehicular Settings Using Computer Vision

Listed in Datasets

By Matthew B Rogers, Dennis Buckmaster1

Purdue University

A Velodyne Puck VLP-16 LiDAR and a Carnegie Robotics Multisense S21 stereo camera were compared for use in dusty agricultural conditions in a dust chamber. Next, the stereo camera was used for volume measurements in a feed bunk and in a grain truck.

Additional materials available

Version 1.0 - published on 25 Aug 2022 doi:10.4231/NE9P-HC76 - cite this Archived on 26 Sep 2022

Licensed under CC0 1.0 Universal

Description

A Velodyne Puck VLP-16 LiDAR and a Carnegie Robotics Multisense S21 stereo camera were placed in an environmental testing chamber to investigate dust and lighting effects on depth returns. The environmental testing chamber was designed and built with varied lighting conditions with corn dust plumes forming the atmosphere. Specific software employing ROS, Python, and OpenCV were written for point cloud streaming and publishing. Dust chamber results showed while dust effects were present in point clouds produced by both instruments, the stereo camera was able to “see” the far wall of the chamber and did not image the dust plume, unlike the LiDAR sensor. The stereo camera was also set up to measure the volume of total mixed ration (TMR) and shelled grain in various volume scenarios with mixed surface terrains. Calculations for finding actual pixel area based on depth were utilized along with a volume formula exploiting the depth capability of the stereo camera for the results. Resulting accuracy was good for a target of 8 liters of shelled corn with final values between 6.8 and 8.3 liters from three varied surface scenarios. Lessons learned from the chamber and volume measurements were applied to loading large grain vessels being filled from a 750-bushel grain cart in the form of calculating the volume of corn grain and tracking the location of the vessel in near real time. Segmentation, masking, and template matching were the primary software tools used within ROS, OpenCV, and Python. The S21 was the center hardware piece. Resulting video and images show some lag between depth and color images, dust blocking depth pixels (dust and occlusion shown in blue in companion videos), and template matching misses. However, results were sufficient to show proof of concept of tracking and volume estimation. This data repository is a companion to a dissertation of the same title. 

Cite this work

Researchers should cite this work as follows:

Tags

The Purdue University Research Repository (PURR) is a university core research facility provided by the Purdue University Libraries and the Office of the Executive Vice President for Research and Partnerships, with support from additional campus partners.