Chris Pollett > Students >
Sneh

    ( Print View)

    [Bio]

    [Blog]

    [CS 297 Proposal]

    [Deliverable 1]

    [Comparison between ARKit and ARCore - PDF]

    [2D to 3D Cartoon Modeling - PDF]

    [YOLO Object Detection iOS - PDF]

    [Deliverable 2]

    [Deliverable 3]

    [ARCritique - PDF]

    [Deliverable 4]

    [CS 297 Report - PDF]

    [CS 298 Proposal]

    [CS 298 Report - 3D AR Reconstruction - PDF]

    [3D AR Reconstruction Slides - PDF]

Project Blog


Week 17: May 22, 2023

  • Present the project

Week 16: May 16, 2023

Holiday

Week 15: May 9, 2023

Submitted slides and got feedback. Discussion about how the defense goes and pointers as to what to keep in mind

Things to do for the next meeting

  • Prepare presentation script

Week 14: May 2, 2023

Presented the final app to the professor. Submitted report to Turnitin.

Things to do for the next meeting

  • Make slide for the presentation
  • Clean up the iOS app

Week 13: April 25, 2023

Finished the server-side code. Received minor feedback on the report

Things to do for the next meeting

  • Make changes to the report as soon as possible
  • Work on the iOS app and establishing connection with the server

Week 12: April 18, 2023

Submitted the first draft of the report. Stuck with figuring out how to connect the phone to the server

Things to do for the next meeting

  • Make changes to the report
  • Work on the iOS app and server

Week 11: April 11, 2023

Designed the server and tested all the interaction

Things to do for the next meeting

  • Work on the report
  • Work on the iOS app and server

Week 10: April 4, 2023

Built an iOS app to click images

Built an iOS app to place the model and allow user to interact with it

Things to do for the next meeting

  • Write code for the server and integrate it with the app
  • Improve the app to make it seemless

Week 9: March 28, 2023

Spring Break

Week 8: March 21, 2023

Runing into new bugs with the 2D image to 3D model.

Things to do for the next meeting

  • Build an iOS app to click images that can be used with this code
  • Build an iOS app to place the model and allow user to interact with it

Week 7: March 14, 2023

Implemented the 2D image to 3D model building. Spoke about the report.

Things to do for the next meeting

  • Build an iOS app to click images that can be used with this code

Week 6: March 7, 2023

Missed the class.

Week 5: February 28, 2023

Stuck on next set of errors when trying to implement an open source version of mesh building.

Things to do for the next meeting

  • Solve these errors
  • Find a way to implement 2d image to 3d model building

Week 4: February 21, 2023

Stuck on errors when trying to implement an open source version of mesh building.

Things to do for the next meeting

  • Solve these errors

Week 3: February 14, 2023

Figured out multiple ways to build meshes. Made a plan to try one of the ways for next week. Spoke about alternates if this method does not work

Things to do for the next meeting

  • Try a method using open3d to build a mesh.

Week 2: February 7, 2023

Talked about the major challenges we will be facing in the CS 298 project. Spoke about timelines and when everything is due. Spoke about texture mapping and mesh building.

Things to do for the next meeting

  • Read articles and figure out a way to build 3D mesh from 2D images

Week 1: January 31, 2023

Meet Professor and decide the schedule for the next semester. Get the proposal approved and get the add code.

Things to do for the next meeting

  • Get caught up with CS 297 material





CS 297 completed






Week 15: November 30, 2022

Submitted deliverable 5. Marked improvements to deliverable 5.

Things to do for the next meeting

  • Update deliverable 5 by adding a paragraph on related work
  • Reach out to professors regarding committee

Week 14: November 23, 2022

Submitted deliverable 4. Spoke about other ideas considered and issues with having the 3D object fixed at a particular distance.

Things to do for the next meeting

  • Upload deliverable 4
  • Start working on deliverable 5

Week 13: November 15, 2022

Unable to show up because sick

Week 12: November 8, 2022

Discussed Paper 4. ARCritique which was about building a model using KinectFusion algorithm and collaboratively working on the model and sharing the model.

Things to do for the next meeting

  • Upload deliverable 3 code
  • Start working on deliverable 4

Week 11: November 1, 2022

Discussed issues with sharing using iMessage. Showed demo of deliverable 3 which implements deep linking. Spoke about the expectations for deliverable 4.

Things to do for the next meeting

  • Upload deliverable 3 and add some media content when deep linking
  • Start working on deliverable 4

Week 10: October 25, 2022

Discussed different ways of building mesh and decided that mesh will be built on the server. Discussed different ways to share 3D models.

Things to do for the next meeting

  • Read more about sharing models using iMessage
  • Finish deliverable 3

Week 9: October 18, 2022

Discovered that Lidar is available only for iPhone 12 Pro and the higher Pro versions which are not available to us. Hence shifted to Photometry and RealityKit method. Submitted deliverable 2.

Things to do for the next meeting

  • Read about other ways to build a mesh
  • Start working on deliverable 3

Week 8: October 11, 2022

Discussed 3 ways to build 3D meshes from 2D images. We finalized that Lidar scanning will be used for the project and if that fails, then we would try Photometry and RealityKit to build the mesh.

Things to do for the next meeting

  • Build mesh using Lidar sensor
  • Try out photometry and RealityKit to build the mesh

Week 7: October 4, 2022

Discussed paper 3. I spoke about laying 3D objects on the surface.

Things to do for the next meeting

  • Finalize how deliverable 2 will be achieved and the components used.

Week 6: September 26, 2022

Discussed paper 2. Spoke about different ways to build a mesh from 2D objects.

Things to do for the next meeting

  • Read research paper 3

Week 5: September 19, 2022

Tested deliverable 1. Spoke about different ways to save room with AR objects. Ideated ways in which the final CS 298 project could be extended from this implementation.

Things to do for the next meeting

  • Read research paper 2
  • Upload deliverables and slides to website

Week 4: September 13, 2022


Discussed research paper 1. Comparative study for ARCore and ARKit. The study was done on ARKit 3 and currently on ARKit 6 hence technology is better. Understood different functions provided by ARKit and our app can be a mixture of a couple of these features. Discussed the different methods of building the app and also if need be then the possibility of integrating with a game engine like Unity.

Things to do for the next meeting

  • Submit deliverable 1
  • Update blog

Week 3: September 6, 2022


Finalised the deliverables and listed details of expectations for each deliverable. Some tweaks are needed in the proposal for better readability. Discussed ARKit and RealityKit and the reasons for using the two. Spoke about features.

Things to do for the next meeting

  • Read research paper 1
  • Clean up proposal

Week 2: August 30th 2022


Discussed the CS 297 proposal. Professor suggested changes and described expectations. Setup an account and did a walkthrough of this site.

Things to do for next meeting

  • Make the deliverables more specific
  • Improve the description of the proposal
  • Read about ARKit and RealityKit

Week 1: August 29th 2022


Finalised project idea and spoke about how to write the proposal. Decided when to meet for CS297. Project idea: Shoe AR Reconstruction

Things to do for next meeting

  • Decide on deliverables for the project
  • Find reference papers for the project
  • Fill the CS297 proposal document