Multi-Modal Fusion Transformer for End-to-End Autonomous Driving — mentioned by chrisco255

Fri, 21 Apr 2023 04:56:57 GMT

We have access to video training data for driving, absolutely tons of it, as we've been attempting to train AI cars for more than two decades now. If GPT4 is what you say it is, we should be able to train it on that video data and solve autonomous driving. There is nothing inherently about transformers that prevents them from taking in video data. They've already been used by some researchers (https://arxiv.org/abs/2104.09224). And yet, you can take a 16 year old who's never driven, and teach them within a week to be decent at it and maybe 50-100 hours of driving training and they're…

Paper and discussion history. A mention is not an endorsement.

Multi-Modal Fusion Transformer for End-to-End Autonomous Driving · HackerPapers discussions

Multi-Modal Fusion Transformer for End-to-End Autonomous Driving — mentioned by chrisco255