The First-Ever Mixed Reality Commerce Experience

Today is an important day in history. It’s a milestone in a new era of computing – spatial computing. At Wayfair, we’re ushering in the next-generation in computing in partnership with Magic Leap to go beyond the 2D screen and compute in your space, as a part of your space, and with an understanding of your space.
We began this journey with Magic Leap over a year ago to explore the potential of Mixed Reality, not as just another AR/VR/MR/XR platform for product visualization, but as a new computing platform – one that will be used as a productivity tool, just as we use our computers today, but not bound to a 2D screen.
Imagine a day when you can see your email on one wall of your space, chats and social networks on another, your calendar on the next wall, perhaps a game you’re playing with remote friends floating on the coffee table, and news and weather reports hovering over your desk. If you want to delete an email, you pull it out and throw it into your real trash can. In a very naive way, this is spatial computing.
Now, imagine browsing the web on this platform. Say you were on Wayfair.com, and saw an item you liked and were wondering how it would look and fit in your space. Imagine if you could just pull it out of the browser and into the desired room – well, now you can! And that’s what we’re demonstrating with our Mixed Reality experience on Magic Leap’s spatial web browser.
We’ve created an experience that allows users to browse a limited set of products in a very familiar construct – the web browser – but with 3D content and interaction beyond the browser chrome. Users are presented with a digital version of the product, placed in a staging room, together with the details of the product itself. Users can then pull the digital version of the product from the staging room into their actual space and visualize it true to scale, and in the context of their desired room. They can also pull in multiple products to experiment with different looks and layouts.
We’ve put together a preview of the experience below:
What better way to shop for the home than from home? At Wayfair, we’re committed to delighting our customers and constantly experimenting with new ideas and experiences. We’re incredibly excited about Mixed Reality as the next evolution of the shopping experience and can’t wait to share what’s next on this platform. Stay tuned!
Responses
August 13th, 2018
Wow, i’m amazed that this i possible. Will this device be using technology similr to google glass to make the measurement dimentsions possible? And will i only need one device to make it possible? Or does it come in a set of devices?
August 16th, 2018
Hi Alain, The technology is different from Google Glass. Glass just showed you information in the corner of your vision, but didn’t understand your space. Magic Leap One understands your space (walls, floors, objects etc) and can render information in the context of your space with real world dimensions. You only need one device to make this possible.
July 17th, 2019
Hello: My name is Gregory Melchior and I’m the CEO and Founder of Propeze.com, an end to end residential real estate solution developed using AI technology. We have trained our neural network over the last two years and now we can take any 2D floorplan and in seconds turn it into an interactive 3D representation of the home with out the need for eyewear. By the end of next month, August of 2019, our platform will allow the home consumer to take a picture of any piece of furniture and visualize in their 3D homes. We are working with BoConcept on a beta test in the city of Toronto and I am reaching out to discuss a possible strategic partnership with Wayfair. Please reach me at greg@4dvw.com or 416-275-2662 to discuss.
August 16th, 2018
sounds great! how many models are viewable? is special modelling and rendering required for this platform?
August 21st, 2018
This is great! Wonder how realistic the experience would be. We specialize in high quality 3D digitization of furniture, fixtures, and many other products. Hope to connect with you. We would love to see how our models perform in this setting.
November 8th, 2018
I cannot wait to see this technology in practice. From designing home interiors to planning weddings and redesigning office layouts. This would be fun to use. Where can I try it?
December 1st, 2018
Now I can see and feel the furniture I want beyond time and space. I want to experience it soon.
January 16th, 2019
Do you have any demo videos which show how it looks from the viewer perspective ?
April 2nd, 2019
Great post!! it; really very important info.
October 16th, 2019
Hey does this app show up with the ML1 OS .97 update? I can’t find it on the Experiences page for the ML1
July 16th, 2020
Wonderful, it looks so realistic. This software will be more helpful for interior designers. Thank you for sharing this great effort, I will certainly recommend this to my cad outsourcing team.