ai-powered autonomous driving vehicle

A research team consisting of Oskar Natan, a Ph.D. student, and his supervisor, Professor Jun Miura, who are affiliated with the Active Intelligent System Laboratory (AISL), Department of Computer Science Engineering, Toyohashi University of Technology, has developed an AI model that can handle perception and control simultaneously for an autonomous driving vehicle. The AI model perceives the environment by completing several vision tasks while driving the vehicle following a sequence of route points.

Moreover, the AI model can drive the vehicle safely in diverse environmental conditions under various scenarios. Evaluated under point-to-point navigation tasks, the AI model achieves the best drivability of certain recent models in a standard simulation environment.

Autonomous driving is a complex system consisting of several subsystems that handle multiple perception and control tasks. However, deploying multiple task-specific modules is costly and inefficient, as numerous configurations are still needed to form an integrated modular system. Furthermore, the integration process can lead to information loss as many parameters are adjusted manually.

With rapid deep learning research, this issue can be tackled by training a single AI model with end-to-end and multi-task manners. Thus, the model can provide navigational controls solely based on the observations provided by a set of sensors. As manual configuration is no longer needed, the model can manage the information all by itself.

The challenge that remains for an end-to-end model is how to extract useful information so that the controller can estimate the navigational controls properly. This can be solved by providing a lot of data to the perception module to better perceive the surrounding environment. In addition, a sensor fusion technique can be used to enhance performance as it fuses different sensors to capture various data aspects.

However, a huge computation load is inevitable as a bigger model is needed to process more data. Moreover, a data preprocessing technique is necessary as varying sensors often come with different data modalities. Furthermore, imbalance learning during the training process could be another issue since the model performs both perception and control tasks simultaneously.

In order to answer those challenges, the team propose an AI model trained with end-to-end and multi-task manners. The model is made of two main modules, namely perception and controller modules. The perception phase begins by processing RGB images and depth maps provided by a single RGBD camera. Then, the information extracted from the perception module along with vehicle speed measurement and route point coordinates are decoded by the controller module to estimate the navigational controls.

So as to ensure that all tasks can be performed equally, the team employs an algorithm called modified gradient normalization (MGN) to balance the learning signal during the training process. The team considers imitation learning as it allows the model to learn from a large-scale dataset to match a near-human standard. Furthermore, the team designed the model to use a smaller number of parameters than others to reduce the computational load and accelerate the inference on a device with limited resources.

Based on the experimental result in a standard autonomous driving simulator, CARLA, it is revealed that fusing RGB images and depth maps to form a birds-eye-view (BEV) semantic map can boost the overall performance. As the perception module has better overall understanding of the scene, the controller module can leverage useful information to estimate the navigational controls properly. Furthermore, the team states that the proposed model is preferable for deployment as it achieves better drivability with fewer parameters than other models.

Future outlook
The team is currently working on modifications and improvements to the model so as to tackle several issues when driving in poor illumination conditions, such as at night, in heavy rain, etc. As a hypothesis, the team believes that adding a sensor that is unaffected by changes in brightness or illumination, such as LiDAR, will improve the model’s scene understanding capabilities and result in better drivability. Another future task is to apply the proposed model to autonomous driving in the real world.

Research Report:End-to-end Autonomous Driving with Semantic Depth Cloud Mapping and Multi-agent

Keyword: AI-powered autonomous driving vehicle

CAR'S NEWS RELATED

Best cars for a 'Love Bug' remake

Tennessee’s Yard Art The Thorndyke Special The Hot Rod The Hippie Van Jim’s Lamborghini Growing up, it’s safe to say my absolute favorite movie was Disney’s “The Love Bug.” As a kid living in a world before Pixar’s “Cars,” it was pretty much the best car movie. I loved ...

View more: Best cars for a 'Love Bug' remake

Audi timing belt tensioner prompts Utah bomb squad visit

An aftermarket timing belt tensioner found in a Salt Lake City apartment prompted a visit from the bomb squad this week after it was mistaken for a potential explosive device. Police partially evacuated the apartment complex in which it was found “out of an abundance of caution” and called ...

View more: Audi timing belt tensioner prompts Utah bomb squad visit

2023 GMC Sierra HD 2500 and 3500 will get more expensive

GMC Sierra HD pickups are about to get more expensive again after recently becoming more expensive, according to GM Authority. In July, GMC and Buick raised the prices on certain vehicles in their lineups anywhere from $975 to $1,675 by making the previously optional OnStar a standard feature. Next ...

View more: 2023 GMC Sierra HD 2500 and 3500 will get more expensive

Our week with EVs: Recapping the diverse collection of electric cars we tested

Mercedes-Benz EQB First Drive Review: Next electric Benz is a little different 2022 Chevy Bolt EV Road Test Review: Time to play EV, gas or airplane 2023 Genesis GV60 Road Test Review: The third of Hyundai Group’s E-GMP EVs is the fastest, but softest It may be hard to ...

View more: Our week with EVs: Recapping the diverse collection of electric cars we tested

Europe car sales lowest since 1996 after 12-month decline

BERLIN – Europe registered the lowest number of new passenger cars in the month of June this year since 1996 at just over 1.06 million vehicles, with some carmakers seeing sales drop by nearly 50%, data from Europe’s automobile association showed on Friday. Volkswagen Group was the hardest-hit major ...

View more: Europe car sales lowest since 1996 after 12-month decline

More Than Just A Carmaker: Toyota Motor PH Launches Toyota Mobility Solutions

Automotive industry leader, Toyota Motor Philippines Corporation (TMP) inaugurated today Toyota Mobility Solutions Philippines, Inc. (TMSPH), a wholly owned subsidiary that will be a provider of mobility-related services. TMSPH ventures into the development and offering of a range of ‘new mobility solutions’ that will enhance Toyota as a brand ...

View more: More Than Just A Carmaker: Toyota Motor PH Launches Toyota Mobility Solutions

'F1 22' feels fast and familiar | Gaming Roundup

‘F1 22’ impressions ‘Construction Simulator’ is launching Sept. 20 Autoblog may receive a share from purchases made via links on this page. Pricing and availability are subject to change. This week in racing game news: ‘F1 22’ impressions At its core, “F1 22,” the latest installment in the F1 ...

View more: 'F1 22' feels fast and familiar | Gaming Roundup

Watch a single-engine plane crash-land on 91 Freeway in California

A single-engine Piper Cherokee airplane was forced to crash land on the 91 Freeway in California after losing power about 45 minutes outside of Los Angeles. Yes, that means this was a very busy highway, practically bursting at the seams with traffic. No, amazingly nobody died, either in the ...

View more: Watch a single-engine plane crash-land on 91 Freeway in California

Ford files 'Mustang Dark Horse' trademark application

Make adventures more comfortable with high-quality Jeep grab handles

New Lucid Air variant to debut & Stealth Look to be on display during Monetary Car Week

Chevy offers incentives to prevent Corvette Z06 flipping

Average U.S. gas price falls below $4/gallon

German court: SUV driver must pay more than a car for running red light

Australian vehicle crash tests to include underwater performance

Toyota C-HR rumored to get revamp next year and an EV version

Geely's electric Zeekr 009 is an EV Alphard we never had; 700 km, 542 PS, top speed 190 km/h

A Newey, Brawn and Anderson row that shows F1 doesn’t change

Sorry, EV buyers, you won't get to pick your own pedestrian safety sounds

There won't be enough copper to meet climate goals, study indicates

OTHER CAR NEWS

; Top List in the World https://www.pinterest.com/newstopcar/pins/
Top Best Sushi Restaurants in SeoulTop Best Caribbean HoneymoonsTop Most Beautiful Islands in PeruTop Best Outdoor Grill BrandsTop Best Global Seafood RestaurantsTop Foods to Boost Your Immune SystemTop Best Foods to Fight HemorrhoidsTop Foods That Pack More Potassium Than a BananaTop Best Healthy Foods to Gain Weight FastTop Best Cosmetic Brands in the U.STop Best Destinations for Food Lovers in EuropeTop Best Foods High in Vitamin ATop Best Foods to Lower Your Blood SugarTop Best Things to Do in LouisianaTop Best Cities to Visit in New YorkTop Best Makeup Addresses In PennsylvaniaTop Reasons to Visit NorwayTop Most Beautiful Islands In The WorldTop Best Law Universities in the WorldTop Richest Sportsmen In The WorldTop Biggest Aquariums In The WorldTop Best Peruvian Restaurants In MiamiTop Best Road Trips From MiamiTop Best Places to Visit in MarylandTop Best Places to Visit in North CarolinaTop Best Electric Cars For KidsTop Best Swedish Brands in The USTop Best Skincare Brands in AmericaTop Best American Lipstick BrandsTop Michelin-starred Restaurants in MiamiTop Best Secluded Getaways From MiamiTop Best Things To Do On A Rainy Day In MiamiTop Most Instagrammable Places In MiamiTop Interesting Facts about FlorenceTop Facts About The First Roman Emperor - AugustusTop Best Japanese FoodsTop Most Beautiful Historical Sites in IsraelTop Best Places To Visit In Holy SeeTop Best Hawaiian IslandsTop Reasons to Visit PortugalTop Best Hotels In L.A. With Free Wi-FiTop Best Scenic Drives in MiamiTop Best Vegan Restaurants in BerlinTop Most Interesting Attractions In WalesTop Health Benefits of a Vegan DietTop Best Thai Restaurant in Las VegasTop Most Beautiful Forests in SwitzerlandTop Best Global Universities in GermanyTop Most Beautiful Lakes in GuyanaTop Best Things To Do in IdahoTop Things to Know Before Traveling to North MacedoniaTop Best German Sunglasses BrandsTop Highest Mountains In FranceTop Biggest Hydroelectric Plants in AmericaTop Best Spa Hotels in NYCTop The World's Scariest BridgeTop Largest Hotels In AmericaTop Most Famous Festivals in JordanTop Best European Restaurants in MunichTop Best Japanese Hiking Boot BrandsTop Best Universities in PolandTop Best Tips for Surfing the Web Safely and AnonymouslyTop Most Valuable Football Clubs in EuropeTop Highest Mountains In ColombiaTop Real-Life Characters of Texas RisingTop Best Beaches in GuatelamaTop Things About DR Congo You Should KnowTop Best Korean Reality & Variety ShowsTop Best RockstarsTop Most Beautiful Waterfalls in GermanyTop Best Fountain Pen Ink BrandsTop Best European Restaurants in ChicagoTop Best Fighter Jets in the WorldTop Best Three-Wheel MotorcyclesTop Most Beautiful Lakes in ManitobaTop Best Dive Sites in VenezuelaTop Best Websites For Art StudentsTop Best Japanese Instant Noodle BrandsTop Best Comedy Manhwa (Webtoons)Top Best Japanese Sunglasses BrandsTop Most Expensive Air Jordan SneakersTop Health Benefits of CucumberTop Famous Universities in SwedenTop Most Popular Films Starring Jo Jung-sukTop Interesting Facts about CougarsTop Best Hospitals for Hip Replacement in the USATop Most Expensive DefendersTop Health Benefits of GooseberriesTop Health Benefits of ParsnipsTop Best Foods and Drinks in LondonTop Health Benefits of Rosehip TeaTop Best Air Fryers for Low-fat CookingTop Most Asked Teacher Interview Questions with AnswersTop Best Shopping Malls in ZurichTop The Most Beautiful Botanical Gardens In L.A.Top Best Mexican Restaurants in Miami for Carb-loading rightTop Best Energy Companies in GermanyTop Best Garage HeatersTop Largest Banks in IrelandTop Leading Provider - Audit and Assurance In The USTop Best Jewelry Brands in IndiaTop Prettiest Streets in the UKTop Best Lakes to Visit in TunisiaTop Highest Mountains in Israel