The app that lets you snap a selfie and chat with DEAD friends: 'With me' app uses 3D scans to create AI avatars that 'live forever'

  • Users take 3D body scans of  living friends or relatives to upload
  • App then transforms the scans into an animated 3D avatar
  • Artificial intelligence helps the avatar communicate and interact with users
  • Avatar remembers personal information of the user and even how they look 

By Stacy Liberatore For Dailymail.com

Published: | Updated:

New technology lets your deceased loved ones live on forever in your smartphone.

A South Korean firm has unveiled an app that allows users to snap selfies and chat with avatars of their dead friends or family members in a bid to help mourners 'overcome their wounded-heart'.

Called ‘With Me’, the app combines 3D technology and artificial intelligence to recreate the image and personality of those who have passed away. 

Scroll down for video 

A South Korean firm has unveiled an app that allows users to snap selfies and chat with avatars of their dead friends or family members in a bid to help mourners 'overcome their wounded-heart'

A South Korean firm has unveiled an app that allows users to snap selfies and chat with avatars of their dead friends or family members in a bid to help mourners 'overcome their wounded-heart'

HOW DOES IT WORK? 

With Me was designed by the South Korean firm, ELROIS.

It was created for those who lost a friend or family member and is having a hard time moving on, as users can interact and communicate with their lost loved one's avatar.

Users first create a 3D scan of their friend or family member, which has to be done while they are a live.

Next, the scan is uploaded to the app where it is reshaped into an avatar.

Users can then take selfies and hold conversations with the digital being. 

The app uses artificial intelligence that helps the avatar recognize the user's face, voice and even remembers personal information about them.

Advertisement

'With Me' is the brainchild of ELROIS, a firm that specializes in photo-realistic 3D avatar solutions. 

‘It was designed for those who lost a friend or family member and are having trouble moving on,' an ELROIS spokesperson told DailyMail.com in an email.

‘Some people told us that our app reminds of 'Black Mirror'.

‘However, when we think about the reason why we take a picture or video, I could say, people want to leave their memories by what we can see forever.'

‘Also, people do everything to remember some precious person to them, or will do anything to move on.’

‘3D photo-realistic avatar is based on the actual person and it has some interaction with the users, so we think the avatars can be the new way to overcome their wounded-heart with a good function of new technology.’

The firm also noted that the app can be used to take pictures with friends who may be away one holiday and it can be used to snap images with your favorite celebrity.

'We are working on the development for making Avatar Cloud Service in the web and mobile to upload their avatars and buy celebrities avatar, clothes and other stuff related with avatars (We call it as 'VAW' or 'vivid avatar world),' shared the spokesperson.

'Now it is still in the process and we have to contact with celebrities' agent sooner to get their avatars.' 

Called ¿With Me¿, the app combines 3D technology and artificial intelligence to recreate the image and personality of a friend or relative who has passed away

Called ‘With Me’, the app combines 3D technology and artificial intelligence to recreate the image and personality of a friend or relative who has passed away

Users first create a 3D scan of their friend or family member, which has to be done while they are a live. Next, the scan is uploaded to the app where it is reshaped into an avatar

Users first create a 3D scan of their friend or family member, which has to be done while they are a live. Next, the scan is uploaded to the app where it is reshaped into an avatar

'VAW (Avatar Cloud Service) service will launch at the end of this year.' 

To get started, you first need to obtain a 3D scan of their living friend or family member, which can only be done at a 3D booth at the moment.

There are two basic ways to scan – you can use a Structure Light Sensor to scan and the other uses between 72 and 112 cameras to take the image needed to create a 3D avatar.

And after the avatar is complete, a reshaping and auto-rigging technical process goes on to make the avatar animated. 

Users can then snap selfies with the digital being and even hold conversations with them – thanks to artificial intelligence.

‘The avatars can interact with the users when they use 'With Me' app. They can talk with users and react in proper way,’ shared the ELROIS spokesperson.

‘They can also track user's face and position.’

‘When a user puts personal information in the app, the avatars remember the user from that time and recognize if there's some changes in the of users as well.

For example, if there is a change in appearance or an emotional change and the avatar will mention something about it, such as 'you look younger today, what is your secret?'

Users can snap selfies with them and even hold conversations with them ¿ thanks to artificial intelligence. The technology helps the avatar recognize the user's face, voice and even remembers personal information about the user

Users can snap selfies with them and even hold conversations with them – thanks to artificial intelligence. The technology helps the avatar recognize the user's face, voice and even remembers personal information about the user

Most watched News videos