Project Blog

Week 12 (Nov 07)

Meeting log:

1. Completed Deliverable 3 and all the queries.

1. Start Report and Documentation

Week 11 (Oct 31)

Meeting log:

1. I completed Kaplan and LogRank with both datasets.

1. Fix Cassandra only loads a small part of the data. Complete queries for Cox proportional hazards (CoxPH) analysis.

Week 10 (Oct 24)

Meeting log:

1. I fixed the Cassandra error that was giving different results.

1. Complete Kaplan-Meier. Write scripts to implement LogRank Test
2. Create a dataset with a billion rows, run data loading and queries against it and record the execution time.

Week 9 (Oct 17)

Meeting log:

1. Continue query execution. Create scripts for aggregate queries and Kaplan-Meier

1. Continue working on Cassandra and creating queries that give consistent results.

Week 8 (Oct 10)

Meeting log:

1. Deliverable 3: Create queries and compare execution time and read performance.

1. Make a couple of scripts of queries and check to see if they have similar results.

Week 7 (Oct 3)

Meeting log:

1. Completed Cassandra Data Loading.

1. Complete Deliverable 2
2. Start Deliverable 3 . Make scripts for running queries and come up with some logical queries for our data.

Week 6 (Sep 26)

Meeting log:

1. Completed QuestDB data loading scrips.

1. Resolve issues of Cassandra and InfluxDB for loading the data in the databases

Week 5 (Sep 19)

Meeting log:

1. Completed MongoDB and Timescale DB script for data loading.

1. Decided to add Cassandra as the fifth database and 2nd NoSQL Database to better evaluate the performance and answer the research question
2. Continue working on other databases and script scripts for loading the data./li>

Week 4 (Sep 12)

Meeting log:

1. Went over Data Loading script. Discussed Deliverable 1 ppt.

1. Start Deliverable 2 (Data Loading)
2. Research drivers and methods to load data in the Databases and generate relevant scripts

Week 3 (Sep 5)

Meeting log:

1. Discussed Deliverable 1 and work on Data generation

1. Complete Deliverable 1 (Data Generation)

Week 2 (Aug 29)

Meeting log:

1. Discussed CS298 Proposal and finalized key Deliverables

1. Start working on Deliverable 1 and find Datasets for Survival analysis

Week 1 (Aug 22)

Meeting log:

1. Discussed Project ideas and plan

1. Create CS298 Proposal and deliverable

Week 14 (May 9)

Meeting log:

1. Discussed Final Report

1. Make final changes and do a accessibility check of the webpages and deliverable PDFs

Week 13 (May 2)

Meeting log:

1. Discussed Deliverable 4.

1. Complete the final report.

Week 12 (April 25)

Meeting log:

1. Discussed the progress and decided to change the database.
2. Decided to implement QuestDB instead of Cassandra.

1. Modify abstract and milestone 3 according to the suggested changes.
2. Complete Data loading and query execution with the updated database and decided queries
3. Summarizing the results and finishing Deliverable 4

Week 12 (April 18)

Meeting log:

1. Discussed the progress of Deliverable 4.

1. Continue working on Deliverable 4

Week 11 (April 11)

Meeting log:

1. Discussed deliverables 4 and suggested some changes.

1. Make changes in layout and deliverable 3
2. Continue working on Deliverable 4

Week 10 (April 4)

Meeting log:

1. Discussed deliverables 3 and suggested some changes.

1. Submit deliverable 3 with the recommended changes
2. Start working on data loading and query execution part

Week 8 (Mar 21)

Meeting log:

1. Went over the databases and their properties/uses.

1. Understand the benchmarking suite and steps to do for benchmarking
2. Understand data/query generation, data loading, and query execution part
3. Finish Deliverable 3

Week 7 (Mar 14)

Meeting log:

1. Discussed project deliverables and project goals.

1. Research the databases and install them locally in Docker.