Assignment 7: Determine facial landmarks
DATE DUE: May 2, 2016
Points possible: 10 points
CS-161: Software Project
Instructor: Rob Bruce

OVERVIEW

For this assignment, you will use Active Shape Modelling to determine facial data points of an an input video. You will then store these facial data points in Postgres.

SPECIFICATIONS

You will use the active shape modelling algorithm proposed by T. F. Cootes, D. Cooper, C. J. Taylor, and J. Graham in their article Active Shape Models - Their Training and Application. Stephen Milborrow has written and released an open-source program called STASM at http://www.milbo.org/stasm-files/5/stasm4.1.0.tar.gz which implements active shape modelling and other computer vision algorithms to determine facial data points. You will download and modify Mr. Milborrow's software to fit into your computer vision pipeline.

1. Your program should accept command line input through argc and argv. Your program will thus use argv to pass in a non-negative integer (video ID) which represents the unique identifer of an input video.

2. Your program will then query Postgres for the following metadata associated with the input video ID:

  • Number of frames
  • Width (pixels) of each frame (in pixels)
  • Height (pixels) of each frame (in pixels)

3. For each frame associated with the video ID in the image repository do the following:

  • Send the frame to STASM for analysis.
  • If STASM returns an array of 77 Cartesian coordinates (x, y) as facial data points, write that data to Postgres. You will also want to write the frame number and VIDEO ID associated with these facial data points to Postgres.

SUBMITTING YOUR PROGRAM

1. Please submit your program as a text file to the Canvas dropbox. I only need the source code. I will build the program myself.

2. Please name your program using the following naming convention:

Lastname_Firstname_assignment_7.c (for C programs)

Lastname_Firstname_assignment_7.cpp (for C++ programs)

Lastname_Firstname_assignment_7.java (for Java programs)

Lastname_Firstname_assignment_7.pl (for Perl programs)

Lastname_Firstname_assignment_7.py (for Python programs)

Lastname_Firstname_assignment_7.sh (for BASH programs)

Lastname_Firstname_assignment_7.csh (for csh programs)

For example, my name is Rob Bruce. If I write my program in the C programming language, my assignment 7 should be named: Bruce_Rob_assignment_7.c

3. Please include your name as a comment at the beginning of your program like this:

/* Rob Bruce */

or this:

// Rob Bruce

4. I usually do not need a makefile to build your programs, regardless of language; however, in the unlikely event that I cannot build your project, I will send an email inquiry as appropriate.

5. I expect your program to build without syntax errors.

6. I expect your program to execute without run-time errors.

GRADING

Points will be deducted for any program that does not meet the specification as outlined above.

LATE ASSIGNMENTS

Assignments submitted after the due date will be worth, at most, 5 points. Additional points will be deducted for programs not meeting the specification as outlined above.