Teaching AI to Drive: An Innovative Project Transforming RC Cars into Autonomous Vehicles

Imagine a classroom where students aren’t just learning about technology, they’re building it. That’s exactly what Jeremy Ellis, a dedicated teacher, did when he embarked on a long-term project with his students to explore the fascinating world of microcontrollers, computer vision, and machine learning.

The Genesis of a Self-Driving RC Car

The project’s goal was ambitious: to transform an ordinary RC car into a self-driving vehicle. Ellis carefully selected the RC Pro Shredder as the platform and equipped it with a VNH5019 Motor Driver Carrier, a servo motor for steering, a Portenta H7 + Vision Shield, and a 1.5″ OLED module. This combination of hardware laid the foundation for a sophisticated autonomous system.

Training the Object Detection Model

To enable the RC car to navigate its surroundings, Ellis and his students needed to train an object detection model. They meticulously collected approximately 300 images of double-ringed markers placed on the floor. These images were then uploaded to Edge Impulse, a user-friendly platform for training machine learning models. With careful labeling of bounding boxes around the markers, they trained a FOMO-based object detection model using the labeled images.

Harnessing the Power of the Portenta Community

The Portenta community, a vibrant hub of knowledge and innovation, came to Ellis’ aid. They generously provided a sketch that captured new images, performed inference on the captured images, and steered the car’s servo accordingly. The sketch also offered the option to display the processed image on the OLED screen, providing valuable insights into the car’s decision-making process.

From Concept to Reality: Building Autonomous Cars

With minor testing and adjustments, Ellis and his class successfully built four autonomous cars capable of following a series of markers on the ground. This remarkable achievement showcased the power of hands-on learning and the transformative potential of technology in education. The students not only gained a deeper understanding of complex concepts but also experienced the thrill of creating something truly remarkable.

Delve Deeper into the Project

For those eager to learn more about this captivating project, Ellis has meticulously documented the entire process in his Edge Impulse tutorial. This comprehensive guide provides step-by-step instructions, allowing anyone to embark on a similar journey of innovation and discovery.

Bonus: The project’s success ignited a spark of inspiration in Ellis and his students. They realized that technology, when combined with creativity and perseverance, can be a catalyst for change. This project not only taught them about AI and robotics but also instilled in them a belief in their ability to make a difference in the world.

In conclusion, Ellis’ project is a testament to the transformative power of education. By empowering students to build self-driving RC cars, he ignited their passion for learning and opened up a world of possibilities for their future endeavors.


Comments

Leave a Reply

Your email address will not be published. Required fields are marked *