CS297 Proposal
Augmented-Life Phone Organizer (ALPO)
Chao-Hsin Shih (chaoh.shih@gmail.com)
Advisor: Dr. Chris Pollett
Description:
Augmented-Life Phone Organizer (ALPO) is an application that I will write
for the iPhone platform. The app will help people get information in life
by using the iPhone to natural augment reality. When the camera is
directed at a building, rental information for units that are viewed
through camera would be displayed as well as its corresponding rental
information. When the camera is directed to a Barcode, the item's
information can be queried in real-time, such as when compared with other
store's prices which are nearby the user or online stores. When the camera
is directed to a restaurant, corresponding printable/digital coupon could
be presented/queried in real-time. When the user needs direction for
nearest gas station/ATM, the arrows pointing to the target location is
displayed accordingly as the user moves phone camera direction from one to
another. When the user parks a car, save the location and they can easily
get it later by viewing the arrow direct the right direction of the
parking space. The app is based on augmented reality technology which
provides user an information layer on top of a view for the real world
using mobile device. Using auxiliary technology that is already present on
iPhone such as GPS, digital compass, as source of data, augmented reality
software technology allows real-time image analysis before overlaying
information that is pertinent to the current geo-location and targeted
phone-view spot.
Schedule:
Week 1:
Aug.25-Sep.7 | Present Yap, et al paper to Dr.
Pollett. Write a simple app to overlay image on camera view (Deliverable 1)
due. |
Week 2:
Sep.8-Sep14. | Explain SIFT algorithm to Dr. Pollett. Dynamically overlay GPS and Accelerometer info on top of camera view |
Week 3-4:
Sep.15-28 | List steps to implement SIFT algorithm. Learn how to use core data by saving the image captured from camera and add EXIF info on it.
(Deliverable 2) |
Week 5:
Sep 29-Oct 4 |
Present Gammeter , et al paper to Dr.
Pollett. |
Week 6:
Oct 5-Oct.11 | Use IQ Engine API to gain info of object. Save the compass info and alert when user direct to same direction |
Week 7-9:
Oct 12-Nov 1 | Save the info of image taken by camera to core data (Update the description of object on list while it's available
|
Week 10:
Nov 2-Nov 8 | Utilize iAds to show related ad according to the object . Save the camera view with the GPS and compass info and overlay on the camera view if the user is near the location of image has been taken
|
Week 12:
Nov 9-Nov 15 | Show annotation on MapView according to xml file including poi in a specific area
|
Week 13:
Nov 16-Nov 22 | Point the direction of given coordination.
|
Week 14:
Nov 23-Nov 29 | Dynamically overlay the hint of poi on camera view
|
Deliverables:
The full project will be done when CS298 is completed. The following
will
be done by the end of CS297:
1. An iPhone app which can overlay image and GPS/compass information on camera view.
2. An iPhone app that makes use of Core Data to store image and info of the image.
3. An iPhone app that can overlay the image as a button on the top of camera view.
3. An iPhone app that can overlay a button point the direction of given coordination.
4. A comprehensive ten page report on my CS297 activities.
References:
Kim-Hui Yap; Tao Chen; Zhen Li; Kui Wu; , "A Comparative Study of Mobile-Based Landmark Recognition Techniques," Intelligent Systems, IEEE , vol.25, no.1, pp.48-57, Jan.-Feb. 2010
doi: 10.1109/MIS.2010.12
Gammeter, S.; Gassmann, A.; Bossard, L.; Quack, T.; Van Gool, L.; , "Server-side object recognition and client-side object tracking for mobile augmented reality," Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on , vol., no., pp.1-8, 13-18 June 2010
Ann-sofie Gunnarsson, Malinda Rauhala, Anders Henrysson, Anders
Ynnerman. (2006). Visualization of sensor data using mobile phone
augmented reality. pp.233-234, 2006 Fifth IEEE and ACM International
Symposium on Mixed and Augmented Reality.
Lee, I. (2009) Towards Wireless Augmented Reality A Review of its
Enabling Technologies. International Symposium.
Daniel Wagner, Dieter Schmalstieg. (2009) Making Augmented Reality
Practical on Mobile Phones. IEEE Computer Graphics and Applications.
|