The document is a project report on augmented reality. It discusses the history and types of augmented reality, including marker-based and markerless augmented reality. It describes an augmented reality app called AmiMap developed by the student for their final year project. The app uses markers to trigger augmented reality content like maps. The report discusses the software, portals and process used to develop the app in Unity and deploy it on Android. It also talks about some problems faced and solutions explored for augmented reality development.

1. Amity University Haryana
Department of Computer Science
& Engineering
Major Project on
“AUGMENTED REALITY”
Under the Guidance of: By:
Mr.Utpal Shrivastava Yash Kaushik(A51405212006)
Asst. Professor
Ms. Juhi Singh
Asst. Professor

2. Augmented Reality
• Modifying Reality
• Implements Informative Layar

4. Basic Example

5. • Invented Head-Mounted Display which was the first
step in making AR a possibility
• Coined the term “Augmented Reality”
• Developed Complex Software at Boeing to help
technicians assemble cables into aircraft
Prof. Tom Caudell

6. • In 1999, Hirokazu Kato of the Nara Institute of
Science and Technology released the ARToolKit to the
open source community.
• Although the smartphone was yet to be invented, it was
what allowed a simple, handheld device with a camera and
an internet connection to bring AR to the masses.
Hirokazu Kato

7.  Free kick radius /
Offside.
 Advertising spots
 Weather Forecast
 Stock
Already common in TV shows

8. Types of Augmented Reality
Marker Based Augmented
Reality
Markerless Augmented Reality
 Location Based

9. Marker based Augmented Reality
• Left image shows the augmented version
• Right image is the marker on which
augmentation is done.

10. Markerless Augmented Reality
Basic example: Google Glass, Live Feeds etc.

11. • GPS + Compass + Gyro + Accelerometer
• Location-based applications use the
ability of a particular device to record
its position in the world and then offer
data that’s relevant to that location:
finding your way around a city,
remembering where you parked the
car, naming the mountains around you
or the stars in the sky.

12. Why?
Need to create an AR app:
• To help people understand the structure
in an easier way.
• For Advancing the Technology used on a
daily basis to next level.
• Introduce the concept AR in Digital Age.
• Increases Brand Image.

13. AmiMap
A Marker Based Augmented Reality App which
help you to assess current location when triggered
with AR markers and show the map of your
surroundings. And one can also interact with it to
find the place they may be looking for. And other
applications covering some aspects of augmented
reality.

14. Purpose of the App
• The purpose of the application is to
introduce the concept of augmented
reality in our life on daily basis.

15. Some Snaps of AmiMap
• C Block Ground Floor on a marker.

16. C Block 3rd Floor

17. How?
• Softwares Used
• Portals Used
• Process
• Deployment

18. Software Used
• Blender  Used to make 3D models.
• Unity  Implementation of Augmented
Reality in an Android APP.
• Android SDK  Used by unity to generate
the android application.
• Eclipse  for apk signing and adding user
friendly interface.

19. Recognition
Tracking
Content
rendering
AUGMENTED REALITY SDK
What to track
Where it is (3D pose)
Your Interesting Stuff

21. Development Portal Used
• Just like android.developer.com we have
used Vuforia Portal for the app
development.
• One more portal recommended by
Vuforia named brosvision came handy to
generate AR Markers.

23. Workflow of AR Apps Via Vuforia

24. Vuforia WorkFlow Objects

25. Process
• Open Vuforia Developer Portal
• Select Target Manager upload the images
that you want to be used as markers
• Download the database for unity
(.unitypackage)
• In the main page of the portal download
the VuforiaSDk for unity as it contains the
ARCamera.

26. Continued
• Import the packages in unity.
• Delete the main camera from hierarchy
use ArCamera instead.
• Import the makers on the scene
• Import the 3d model that is to be
displayed
• Put the 3d model on the marker
• In ArCamera load the dataset and
activate

27. • Add some Directional Light into the scene
• Press Play Button in Unity if you have
webcam and let the augmentation begin.
• Place the marker in front of the Webcam and
a 3d model will be displayed on top of it.
• Switch Platform in build setting and import
the Android App.

28. Problems
Performance,
Image Recognition
• Symmetry/similar elements
• Contrast/illumination
Real world sizing,
Fixed Camera vs Fixed Space,
Physics

29. Tips and Advices
• No more than 3objects/marker
• Attach marker to cardboard
• Good lighting but avoid Reflections
• Disable objects that are not in the View
• Scale correctly from the beginning

30. Extra Work Done
Kinect
• Kinect is an input device by Microsoft which features an "RGB
camera, depth sensor and multi-array microphone running
proprietary software", which provide full-body 3D motion
capture and facial recognition. The Kinect is currently the
hardware that provides developers with the greatest
opportunities for innovative programs both games and serious
artificial applications. A depth camera, which sees in 3-D,
creates a skeleton image of a player and a motion sensor
detects their movements. Speech recognition software allows
the system to understand spoken commands and gesture
recognition enables the tracking of player movements.

31. • Kinect’s camera is powered by both hardware
and software. And it does two things: generate
a three-dimensional (moving) image of the
objects in its field of view, and recognize
(moving) human beings among those objects.
• We have Used Three Softwares to acquire a
better understanding of its work. And how its
can be used in augmented reality projects.

32. Software Used
• Skanect = To generate 3D models.
• OpenNi Virtual WebCam = A virtual WebCam
software to show IR(infrared), Depth Sensor.
• FaceTrackNoIr= An Open Source software used
to track Face Movement.

33. Skanect Snaps

34. OpenNi Virtaul WebCam Snaps

35. FaceTrackNoIr Snaps

36. 3D model generated via skanect

37. Future Scope
• Ar and Vr is about to become one.
• AR + VR = Mixed Reality
• HoloLens is about to change the way we perceive
things.
• After there are even rumours of Ar Contact Lens
and even a lot of studies is going on this topic in
University of Washington.

38. References
[1] http://www.3pillarglobal.com/insights/how-to-
create-an-augmented-reality-app
[2] http://habiletechnologies.com/kickstarting-
augmented-reality-hello-world-vuforia-tutorial/
[3] http://developer.vuforia.com
[4] http://brosvision.com/ar-marker-generator
[5] http://forums.unity3.com/
[6]
http://www.slideshare.net/aquarioverde/introductio
n-to-ar-with-unity3d

39. THANK YOU