MIS-EN-SCENE – 3:30 PM

Presented By-

Maitreyee Bhise &

Purvi Agrawal

Introduction To Augmented Reality

Digitally enhanced view of the real world Use of iphone camera & sensors to reduce the

gap between what we see, hear and feel and what’s computer generated.

* Source – www. Layar.com

MIS-en-SCENE A French word which means telling a story Utilizes augmented reality technology to bridge

analog- digital gap in the study of film journals Recognizes images or text based phrases

(pictures, photographs, film stills) contained in documents

Display associated AR content linked to those document images and then play in a multimedia

DEVELOPMENT TEAMALEX MORTON BRETT MINOR

JEREMY SCHAFFER JOEL GEAR

JUSTIN THEISEN MAITREYEE BHISE

PURVI AGRAWAL SEAN BEATTIE

TOM WELCH

FEATURES INCLUDED IN OUR APPLICATION

Scanning the images in the journal Image recognition Augmented Reality Content

Image Gallery feature Multimedia features

SCANNING

Scan the images or text from the journal using the camera functionality so that other features such as image/text recognition can be implemented

Used to scan images from the articles of cinema and film journals. Once the image is scanned, the AR content associated with it is triggered and played in the multimedia player.

IMAGE RECOGNITION When a user scans an image in the journal with

the camera, the app recognizes the scanned image and then search for the Augmented Content related to the scanned image in the database.

Augmented Reality Content

A scanned journal image can be associated with either an image or with an audio/video augmented reality content. Image as AR content

The augmented image will be opened with a PHP file which has all the images. Audio/Video as AR content

If the content type is audio/video only streaming is done from the path mentioned. The audio/video file is not downloaded.

DATABASE

Using a local database Each Journal is associated with an unique ID A table to hold each journal and its associated

augmented reality content path as a record While launching, the path to the AR content is

looked against journal’s unique ID

DATABASE SCHEMA

cs_mes_3

Journals

journal_name  

journal_volume

journal_issue  

journal_article

target_img    

content_type  

content_link     patch jid        

    aid            

MILESTONE ACHIEVED SCANNING

Faced linking, compilation errors and logical issues

IMAGE RECOGNITION Planned to use Metaio CVS (Continuous Visual Search).

But it did cost up to $600 to $1,000 a month. As a result, we implemented our own tracking

configuration.

MILESTONE ACHIEVED(Cntd.) AUGMENTED REALITY CONTENT

Image as AR content Client wanted augmented image to be opened in

image gallery. Audio/Video as AR content

Play button to be displayed in the multimedia player instead of directly playing the content

Full screen requirement User can take the phone away from the target without

the movie stopping. Metaio player stops the audio/video as soon as the

camera is moved away from the image.

MILESTONE ACHIEVED(Cntd.) DATABASE

Faced hurdles in direct connectivity to database Use of SQLite as standard database system for Apple Use of MYSQL as standard database system in our

database

FEATURES INCLUDED IN FUTURE ITERATIONS

Text Recognition QR Code Scanning

TEXT RECOGNITION When a user scans text based phrases in the

journal, the app must be able to recognize the scanned text and then trigger the appropriate Augmented Content related to it.

Metaio SDK does not support Text Recognition. Feature Complexity and Time Constraints. Trial version implementation treats text as an

image. On scanning the text, a video content is

triggered.

Text Recognition

QR CODE SCANNING

Scans QR Code on the front page of the Journal. Informs user if the Journal has any AR content in

it. The app is able to scan a QR Code and identify it. Works at back end. Front end implementation pushed to future

iterations.

UI DESIGN Application exclusively design for the study of

cinema journals. App starts with a splash screen which justifies

the purpose of the app. The user interface consists of the features

implemented in the project.

UI DESIGNLoading Screen

This is the first Page with which the User is greeted.

The main page of the app consists of two options: Either the user can select the journal from Select Article to Scan option. Or the user can directly select SCAN option and the camera will start.

UI DESIGN

If the user selects, ‘Select Article to Scan’, option. The first page is the Volume. The user selects the volume from which he wish to scan an article.

UI DESIGN

After a Volume is selected, the next page displays the list of journals in the Volume.

UI DESIGN

After a Journal is selected, the next page displays the list of articles in the journal.

UI DESIGN

When an article is selected the following page is displayed .1. The Label option gives a brief information about the selected article such as Article and Author name and so the user can decide if this is the article hewish to scan.2. The Download option download all The AR content related to that article.3. Scan will start the camera to enable the user to scan the images in the article.

UI DESIGN

If the user selects, ‘Scan’, option, the app directly starts The camera functionality so that the user can scan the images in the article.

UI DESIGN

CONCLUSIONOur application successfully scans and recognizes images from the journal and is able to play the associated augmented reality content in a multimedia player!!

“Its not the destination but the journey that teach

us”We learnt ….

Agile Methodology Team Work Team Coordination Team Communication

ACKNOWLEDGMENTS Thank You Dr. Chao. Our Clients, Dr. Ted Rippey and Chris Wagenheim. Our Incredible Team And

Thank You for Listening

Any Questions