Chris Pollett > Students > Gupta

    Print View

    [Bio]

    [Blog]

    [CS 297 Proposal]

    [Deliverable 1: Gedit-Python Extension]

    [Deliverable 2: Camera Capture Tool]

    [Deliverable 3: Detect Head Movement]

    [Deliverable 4: Map Text to Head Movement]

    [CS 297 Report - PDF]

    [CS 298 Proposal]

    [CS 298 Report - PDF]

    [CS 298 IHFTES Slides - PDF]

CS297 Proposal
Improved Hand's Free Text Entry System

Gaurav Gupta (gaurav.gupta@sjsu.edu)

Advisor: Dr. Chris Pollett

Description:

There are several technological advancements in the field of input entry mechanism. Several modes for input entry have been introduced in past couple of decades like touchscreen-based input entry, speech-based text input entry, image-based text input entry, and several others. But still, there is space for another mode of input mechanism. In the current proposal, text input would be generated with the help of head movements.

Input entry based on the head movements has not been leveraged to its full potential, There are currently two research paper's that talks about generating text with the help of head movements, which are from Adam Nowosielski. Link to the research paper is added in reference section at the bottom of the page.

Completion of this project will significantly help people who are disabled and still not able to interact with computers properly.

Schedule:

Week 1: Aug. 29 - Sep. 4Project topic discussion meeting with Dr. Pollett
Week 2: Sep. 5 - Sep. 11Finalized on project topic and deliverables for the project, First Presentation on prior work done by Adam Nowosielski
Week 3: Sep. 12 - Sep. 18Deliverable 1: Simple Python Plugin for Gedit tool
Week 4: Sep. 19 - Sep. 25Read on techniques to capture images on Mac using Python
Week 5: Sep. 26 - Oct. 2Deliverable 2: A tool implemented in Python to Capture images using camera of Mac
Week 6: Oct. 3 Oct. 9Read and present on prior work on face tracking
Week 7: Oct. 10 Oct. 16Read and present on prior work on head movement after tracking face of user
Week 8: Oct. 17 Oct. 23Work on Deliverable 3
Week 9: Oct. 24 Oct. 30Deliverable 3: Head movement detection using Python
Week 10: Oct. 31 - Nov. 6Read existing work on input mechanisms which reduces the number of input key selection
Week 11: Nov. 7 - Nov. 13Work on Deliverable 4
Week 12: Nov. 14 - Nov. 20Deliverable 4: Implement existing UI
Week 13: Nov. 21 - Nov. 27Work on CS297 report Draft 1
Week 14: Nov. 28 - Dec. 4Work on CS297 report Draft 2
Week 15: Dec. 5 - Dec. 11Deliverable 5. CS 297 report

Deliverables:

The full project will be done when CS298 is completed. The following will be done by the end of CS297:

  1. Simple Python Plugin for Gedit tool.
  2. A tool implemented in Python to Capture images using camera of Mac.
  3. Head movement detection using Python.
  4. Implement existing UI.
  5. CS 297 report.

References:

  1. [2017] 3-Steps Keyboard: Reduced Interaction Interface for Touchless Typing with Head Movements. Adam Nowosielski. in Proceedings of the 10th International Conference on Computer Recognition Systems CORES 2017, Polanica Zdroj, Poland, 2017. [Online]. Available: https://link.springer.com/chapter/10.1007/978-3-319-59162-9_24.
  2. [2017] Two-Letters-Key Keyboard for Predictive Touchless Typing with Head Movements. Adam Nowosielski. 17th International Conference, CAIP 2017, Ystad, Sweden, Proceedings, Part I. [Online]. Available: https://link.springer.com/chapter/10.1007/978-3-319-64689-3_6.
  3. [2016] A Face Detection Algorithm Based on AdaBoost and New Haar-Like Feature. Songyan Ma, Lu Bai. 7th IEEE International Conference on Software Engineering and Service Science (ICSESS). [Online]. Available: http://ieeexplore.ieee.org/document/7883152/.
  4. [2017] Face Detection Based on Skin Color and AdaBoost Algorithm. Chongshan Lv, Ting Zhang, Cong Lin. 29th Chinese Control And Decision Conference (CCDC). [Online]. Available: http://ieeexplore.ieee.org/document/7978729/.
  5. [2011] Optimization of Head Movement Recognition Using Augmented Radial Basis Function Neural Network. Mitchell Yuwono, A.M. Ardi Handojoseno, H.T. Nguyen. 33rd Annual International Conference of the IEEE EMBS. [Online]. Available: http://ieeexplore.ieee.org/document/6090760/.
  6. [2011] Head Movement Recognition Based on LK Algorithm and Gentleboost. Liu Jian-zheng, Zhao Zheng. Networked Computing and Advanced Information Management (NCM). [Online]. Available: http://ieeexplore.ieee.org/document/5967551/.
  7. [2012] Head Movement Recognition Based on Lucas- Kanade Algorithm. Zheng Zhao, Yuchuan Wang, Shengbo Fu. International Conference on Computer Science and Service System. [Online]. Available: http://ieeexplore.ieee.org/document/6394889/.