DamageCheckAR

Augmented Reality Earthquake Damage Assessment Tool / Simulator

Visual Analysis of Structural Damage to Buildings, Walls & Columns

– MagicLeap Augmented Reality

– MagicLeap LuminSDK

– iOS Mobile Application ARKit & CoreML

MagicLeap Screenshots

Installation

MagicLeap Developer

• Here are a few helpful links to help you get started with Magic Leap Development!
• Sign up for a developer ID here at our developer portal. https://developer.magicleap.com/home
• First time setup: https://developer.magicleap.com/learn/guides/develop-setup – in order to get access to the Lumin SDK, you will need to download The Lab located in the hyperlink above.
• To convert a section of google maps to 3d maps in unity using 3d map generator (adobe plugin – 21 USD) Terrain.party – move map to the desired location then save file, but remember at which km it was scaled at. https://www.gimp.org/downloads/

MAGIC MAPS

SEISMIC Activity

• Tools that we used – https://www.3d-map-generator.com/ which was the fastest compared to mapbox unity which wasn’t compatible well with magic leap due to rendering issues, files exported from adobe as an obj, mtl and png file just in case a texture.
• Made the maps with 3d map generator adobe plugin and height mapper. Then transfer the obj and mtl file to unity3d and then insert a png if no texture shows up.

Inspiration

Earthquakes in Puerto Rico

• Creating Augmented Reality Experience to Assess & Simulate Earthquake Damage

What it does

• Distinguishing Earthquake Damage and Structural Integrity through Visual Inspection

How we built it

• MagicLEAP Augmented Reality
• Unity3D
• 3D Map Generator – Adobe Plugin
• Google Maps Satellite Images
• 8th Wall
• Adobe Photoshop
• Adobe XD
• iMovie
• CoreML
• ARKit

Challenges

• 3D Map Generation Cannot Render in Real-Time, Hardware Issues with SDK & Building Application, Operating System Drivers Incompatibility, Importing 3D Models, Scaling Environmental Variables, Integrating Audio Cues, Utilizing AR Hardware

Accomplishments

• Mixed Reality Spacial Computer, Scaling 3D Models in MagicLeap Augmented Reality, Linking Structural Audio Cues, Creating Interactive Spacial Experiences for Earthquake Simulation, Cross Platform AR & Mobile Integration

What we have learned

• MagicLeap AR Development, 3D Map Generation, Stereo to Mono Audio Conversions, Domain Knowledge / Types of Structural Damage to Walls, Columns & Foundations, Earthquake Simulation, iOS application development

What’s next for DamageCheckAR

• iOS Mobile Application for Visual Inspection with Artificial Intelligence & Machine Learning
• NormCore – Multi-User Collaboration through Spacial Anchors

Tools we utilized

• https://www.magicleap.com
• https://unity.com
• https://www.8thwall.com/products-xr
• https://www.3d-map-generator.com/
• https://developer.apple.com/documentation/arkit
• https://developer.apple.com/documentation/coreml
• https://www.google.com/maps/place/Puerto+Rico/@18.2078363,-67.7074406,8z/data=!3m1!4b1!4m5!3m4!1s0x8c0296261b92a7f9:0xf336ec2818049b1a!8m2!3d18.220833!4d-66.590149
• https://www.audacityteam.org/
• https://www.adobe.com/products/photoshop.html
• https://www.adobe.com/products/xd.html

Resources / Research

• https://www.usgs.gov/media/images/2020-puerto-rico-earthquake-sequence-jan-16-2020
• http://www.curee.org/projects/EDA/docs/QED-02_2004-1.pdf
• https://www.iitk.ac.in/nicee/wcee/article/2592.pdf
• https://www.iitk.ac.in/nicee/wcee/article/0705.pdf
• https://www.fema.gov/media-library-data/20130726-1507-20490-6988/fema_307.pdf
• https://www.researchgate.net/publication/324707011_Crack_and_Noncrack_Classification_from_Concrete_Surface_Images_Using_Machine_Learning
• https://arxiv.org/pdf/1812.05659.pdf

Audio Effects – For AR Simulation

• https://www.zapsplat.com/wp-content/uploads/2015/sound-effects-14566/zapsplat_zapsplat_nature_earthquake_earth_crack_debris_rock-split_fall_in_17775.mp3?_=1
• https://www.zapsplat.com/wp-content/uploads/2015/sound-effects-14566/zapsplat_zapsplat_nature_earthquake_rumble_crack_appear_debris_fall_into_movement_17776.mp3?_=2
• https://www.zapsplat.com/wp-content/uploads/2015/sound-effects-blastwave-fx/Blastwave_FX_EarthquakeWithDebris_HV.213.mp3?_=3

Photos:

• https://www.rescue.org/article/earthquake-haiti
• https://www.usgs.gov/media/images/2020-puerto-rico-earthquake-sequence-jan-16-2020

Puerto Rico – Tectonic Plates

Puerto Rico – Guanica