Project Description

GEO+

Everyone takes the exact same Instagram travel photos or videos. So how to make your videos unique? Use GeoPlus! This all-in-one IOS application provides you the opportunities to unlock different AR stickers based on your location (nation flags, iconic building, festival animation, and we are going to provide more!) We are also providing secret surprise based on facial expression and the utility of geolocation are going to integrate with more features (weather condition and so on).

We are here to bring out the most unique selfie experience for travelers! 🇺🇸🇨🇳🇮🇳🇨🇦🇮🇸🇯🇵🇰🇷🇮🇹

SUPERPOWER

After collecting feedback from P1 and P2, we want to expand our application to launch more features to enhance the user experience by using AR. We brainstormed and got inspiration from the successful X-man series.

We would like to endow our users with super power only appeared in movies, including power in hands, drawing on air etc. The user is able to take a video of another person who has super power in the AR world by using the screen recording of iPhone. Then the other person is able to share the video on social media to show their love of mutants or X-man.

Progress Status

• Finished our MVP as following:
  • Fetch and parse the geolocation. Enable user to take selfie or video recording and stored in their Photos.
  • Face recognition: including the basic functionality such as detecting the face rotations, positions of eyes, etc
  • Rendering 3D animation / “filter” based on the previous face detection and based on location information
• Finished our projects with following technical achievements:

Geo+

• Fetch and parse the geolocation. Enable user to take selfie or video recording and stored in their Photos.
• Face recognition: including the basic functionality such as detecting the face rotations, positions of eyes, etc
• Rendering 3D animation / “filter” based on the previous face detection and based on location information

Superpower

• Robot shadowing body: We can track human body in real time and create a robot body mimicking the human body pose and follows the user
• Integrate robot into human body: After clicking the "start animation" button, the robot will gradually be integrated into the user's body. Not only is the robot moving to the person, but also it is becoming transparent.
• Superpower hands: After clicking the "superpower" button, there would be superpower effects showing on the user's hands
• Draw superpower: After clicking the "draw" button, user is able to draw anything on air and the drawings are colorful and exists in 5 seconds by default. The duration can be modified through the slider on screen.
• Make the sphere disappear: User is able to place a sphere on the detected plane, then if user can kick the sphere using their legs, the sphere will disappear.

• Individual technical contributions:

Geo+

• (Yue) Use ARFaceTrackingConfiguration to construct the face mesh for front camera (TrueDepth)
• (Yue) Ability to fetch and locate key component of five senses based on ARFaceAnchor
• (Yue) Ability to distinguish facial expression and display on UI
• (Yezhou) Design and build 3D animation
• (Yezhou)Render and update 3D model based on anchor's location
• (Jiahui) Fetch and parse geolocation
• (Jiahui) Convert the geolocation data into the country and town in real-time
• (Jiahui) UI Interface to take the photo and show the geolocation related data
• (Jiahui) Ability to take a photo / record a video and stored in photos

Superpower

• (Yue) Implemented the human body tracking
• (Yue) Create a new prefab for human body robot to be utilized in further features
• (Yue) Implement the basic functionality to change effects, undo, reset, plane detection (other teammates finalize and optimize these)
• (Yue) Implement the superpower effect using Particle system and anchors of human body tracking
• (Yezhou) Implemented the animation of integrating the mimicking robot with the tracked human body
• (Yezhou) Implemented drawing on air super power effect and the duration of the drawing can be controlled through the slider on screen
• (Yezhou) Implemented Reset function to clear all effects
• (Jiahui) Implemented the plane detection
• (Jiahui) Implemented touching the screen and put the ball in the plane
• (Jiahui) Implemented when kicking the ball, the ball disappeared

Meet Our Team