Chris Pollett > Students >
Chao-Hsin
    ( Print View )

    [Bio]

    [Project Blog]

    [CS297 Proposal]

    [SIFT Algorithm Slides-PDF]

    [SIFT Implement Steps Slides - PDF]

    [Seliverable 1-ZIP]

    [Deliverable 2-ZIP]

    [CS298 Proposal]

    [CS298 Report-PDF] 

                          

























CS297 Proposal

Augmented-Life Phone Organizer (ALPO)

Chao-Hsin Shih (chaoh.shih@gmail.com)

Advisor: Dr. Chris Pollett

Description:

Augmented-Life Phone Organizer (ALPO) is an application that I will write for the iPhone platform. The app will help people get information in life by using the iPhone to natural augment reality. When the camera is directed at a building, rental information for units that are viewed through camera would be displayed as well as its corresponding rental information. When the camera is directed to a Barcode, the item's information can be queried in real-time, such as when compared with other store's prices which are nearby the user or online stores. When the camera is directed to a restaurant, corresponding printable/digital coupon could be presented/queried in real-time. When the user needs direction for nearest gas station/ATM, the arrows pointing to the target location is displayed accordingly as the user moves phone camera direction from one to another. When the user parks a car, save the location and they can easily get it later by viewing the arrow direct the right direction of the parking space. The app is based on augmented reality technology which provides user an information layer on top of a view for the real world using mobile device. Using auxiliary technology that is already present on iPhone such as GPS, digital compass, as source of data, augmented reality software technology allows real-time image analysis before overlaying information that is pertinent to the current geo-location and targeted phone-view spot.

Schedule:

Week 1: Aug.25-Sep.7Present Yap, et al paper to Dr. Pollett. Write a simple app to overlay image on camera view (Deliverable 1) due.
Week 2: Sep.8-Sep14.Explain SIFT algorithm to Dr. Pollett. Dynamically overlay GPS and Accelerometer info on top of camera view
Week 3-4: Sep.15-28List steps to implement SIFT algorithm. Learn how to use core data by saving the image captured from camera and add EXIF info on it. (Deliverable 2)
Week 5: Sep 29-Oct 4 Present Gammeter , et al paper to Dr. Pollett.
Week 6: Oct 5-Oct.11Use IQ Engine API to gain info of object. Save the compass info and alert when user direct to same direction
Week 7-9: Oct 12-Nov 1Save the info of image taken by camera to core data (Update the description of object on list while it's available
Week 10: Nov 2-Nov 8Utilize iAds to show related ad according to the object . Save the camera view with the GPS and compass info and overlay on the camera view if the user is near the location of image has been taken
Week 12: Nov 9-Nov 15Show annotation on MapView according to xml file including poi in a specific area
Week 13: Nov 16-Nov 22Point the direction of given coordination.
Week 14: Nov 23-Nov 29Dynamically overlay the hint of poi on camera view

Deliverables:

The full project will be done when CS298 is completed. The following will be done by the end of CS297:

1. An iPhone app which can overlay image and GPS/compass information on camera view.

2. An iPhone app that makes use of Core Data to store image and info of the image.

3. An iPhone app that can overlay the image as a button on the top of camera view.

3. An iPhone app that can overlay a button point the direction of given coordination.

4. A comprehensive ten page report on my CS297 activities.

References:

Kim-Hui Yap; Tao Chen; Zhen Li; Kui Wu; , "A Comparative Study of Mobile-Based Landmark Recognition Techniques," Intelligent Systems, IEEE , vol.25, no.1, pp.48-57, Jan.-Feb. 2010 doi: 10.1109/MIS.2010.12

Gammeter, S.; Gassmann, A.; Bossard, L.; Quack, T.; Van Gool, L.; , "Server-side object recognition and client-side object tracking for mobile augmented reality," Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on , vol., no., pp.1-8, 13-18 June 2010

Ann-sofie Gunnarsson, Malinda Rauhala, Anders Henrysson, Anders Ynnerman. (2006). Visualization of sensor data using mobile phone augmented reality. pp.233-234, 2006 Fifth IEEE and ACM International Symposium on Mixed and Augmented Reality.

Lee, I. (2009) Towards Wireless Augmented Reality A Review of its Enabling Technologies. International Symposium.

Daniel Wagner, Dieter Schmalstieg. (2009) Making Augmented Reality Practical on Mobile Phones. IEEE Computer Graphics and Applications.