What’s Next in this Disruptive Journey?

We are in this business to challenge the market for the sake of the customer. At SXSW, we’re previewing the latest evolution of Auto Navigator in the form of a new functionality:

Augmented Reality Feature: We have realized that car research is a constant process that customers are engaged in, even when they are not actively looking to buy a car. In the coming months, we plan to offer an augmented reality experience to our customers through the Capital One Mobile app, allowing them to scan cars via their mobile phones to view individualized information related to each car. This could include information such as their pre-qualified financing, their estimated monthly payment, nearby dealerships where they could buy the car, and much more. Imagine customers being able to get access to this type of individualized information at the point of need, real-time!
The Tech Behind It
Upon launch, the Augmented Reality feature will leverage Apple’s recently-announced augmented reality framework (ARKit) and their new mobile machine learning framework (CoreML) as well as Capital One proprietary models to identify and price cars. The feature is also compatible with Android, using ARCore and Tensorflow mobile.

ARKit enables us to detect surfaces and planes and create a 3D scene that we can then use to place our AR assets, while CoreML allows us to take images from the video stream and pass them through our Convolutional Neural Network to get predictions about the vehicle. We’ve optimized the experience so customers can scan multiple cars in a session, and get more information about a car they’ve already scanned (even after scanning several). We then utilize Capital One’s proprietary models to customize the offer so they can see their estimated monthly payment.

Empowering people to feel confident about their relationship with their money is at the heart of what we’re doing, and with Auto Navigator, we’ve found a way to do this while providing an ultimate digital experience that fits more naturally into people’s lives.

These opinions are those of the author. Unless noted otherwise in this post, Capital One is not affiliated with, nor is it endorsed by, any of the companies mentioned. All trademarks and other intellectual property used or displayed are the ownership of their respective owners. This article is © 2018 Capital One.

Related Posts

Leave a Reply

Your email address will not be published. Required fields are marked *