CS297 Proposal

Description:

As stated by psychologist Gibson, 'The affordances of the environment are what it offers the animal, what it provides or furnishes, either for good or ill. The word affordance implies the complementarity of the animal and the environment'. The property of an object and how that object can be used by the user in the environment defines the affordances of the environment. In this project, we would predict the affordances of the environment from the learned affordances. We will create our dataset using Unity consisting of thousands of videos of grocery shopping store. On those videos, we will train our model and using these learned affordances we will try to predict the affordance of an unseen environment.

Schedule:

Deliverables:

The full project will be done when CS298 is completed. The following will be done by the end of CS297:

1. Perform object detection and image classification using OpenCV and Keras

2. Generate synthetic video dataset of Humanoid picking objects using Unity

3. Research existing techniques(or methodologies) to predict the visual affordance of unseen environment.

4. Try to implement model architecture of one of the selected research techniques

5. CS 297 report due.

References: