Using Computer Vision & Artificial Intelligence to Monitor Cargo Inside Large Commercial Trailers for Trucking
A Project between ZF and Gestoos
EDITOR: MARC GEHRING
Computer vision (CV) and AI technology have advanced to a point where it is possible to reliably evaluate camera footage to gain valuable business insights. In the highly standardized logistics industry, for example, monitoring the cargo is critical to reducing unused space, improving worker safety, and detecting movements that could damage the cargo and the vehicle.
T he road freight logistics industry, which has an estimated global market size of €1,810B and an expected growth rate of 6.5% per year, is a mature industry where differentiation is hard to achieve. Hence, companies are turning towards advanced technical solutions to get an edge over their competitors. Accordingly, numerous startups, which aim at finding appropriate solutions, have sprung up in recent years. Among them is Gestoos, which offers an AI platform that enables cameras and sensors to see, understand, and respond to movement and behavior in any environment. In this context, ZF was introduced to Gestoos back in November 2019. As a leading vehicle parts maker, ZF provides innovative logistics solutions in order to respond to customer requests.
Therefore, ZF’s initial interest was around using computer vision and AI to understand the height profile of the cargo at any given point in time within large commercial trucking trailers (around 14 meters in length). The height profile was needed for the entire trailer area, front to back and side to side. This information, along with additional sensor information, would then be used for the operational and logistical optimization of cargo trailers.
The Project
ZF and Gestoos agreed that the aspired solution should involve three elements: 1) computer vision/AI software, 2) 3D depth-sensing camera, and 3) business logic software, which would receive the inputs from the CV/AI software and camera hardware. After an initial feasibility study, the scope of the project was expanded to also include safety and security features. To simplify future commercial installation, the software was installed and ran on the camera’s CPU , eliminating the need for an external computing unit. Both two-camera and one-camera options were explored in the feasibility study, with the decision to use a one-camera system for both hardware cost reduction and retrofit simplification.
Outcome
The joint team effort resulted in the development of a cargo monitoring solution whose benefits will include increased operational efficiency and improved safety. A working prototype, which was enhanced over time to include all desired features, was first created and tested in January 2020. In the process, several complications (mostly corner cases) arose, which the teams solved through close collaboration.
Future Outlook
The next step for this project is to launch commercial pilots once the final camera hardware (time-of-flight sensors) is selected to fully test the solution in real-world environments.
Acknowledgements
We would like to express our sincere thanks to Pierre de Rochambeau (ZF, Product Owner Trailer and Cargo Telematics, Fleet Solutions), Konrad Feyerabend (ZF, Global Innovation Domain Leader Connectivity, Product Innovation) and Todd Stein (Gestoos).
About STARTUP AUTOBAHN
STARTUP AUTOBAHN powered by Plug and Play is a neutral innovation platform moderating an in-depth and curated collaboration between core partners from industry and young tech companies. The program is stage agnostic and designed to accelerate start-ups by connecting them to the right business units of our Corporate Partners in order to lay the groundwork of a successful cooperation and eventually outstanding pilot projects, implementations or investments.
Plug and Play Tech Center, Mercedes-Benz AG, ARENA2036, University of Stuttgart, ZF, DXC Technology, Porsche, BASF, Webasto, Motherson, DPDHL, Bosch, Schaeffler, STMicroelectronics, Murata, AGC, Hyundai, Linde, BP, Wieland, Faurecia, Eberspächer, ADAC, Sekisui, Plastic Omnium, Zenzic, Maxion, Novelis, ITT, Grupo Antolin, Huf Group, CEAT
Contact for this project
Alina Biermann, Ventures Associate, STARTUP AUTOBAHN powered by Plug and Play, alina@pnptc.com
Dr. Gandert Van Raemdonck, Head of Innovation Lab Commercial Vehicle Systems, ZF Friedrichshafen ,gandert.vanraemdonck@zf.com
Joscha Märkle-Huß, Global Venture Scouting, ZF Friedrichshafen joscha.maerkle-huss@zf.com
