We aim to provide an instantaneous, accessible, low-cost COVID-19 testing alternative that has high reliability and accuracy to help limit the spread of COVID-19 throughout the world.
An algorithmic model (ML?) to process the user's audio sample and diagnose COVID-19 with minimum of >90% sensitivity and >95% specificity and a target of >92% sensitivity and >99% specificity.
As a person who wants to get tested for COVID-19 at any time in any location with access to a smartphone, I want to get my results instantly, with minimal cost, minimal travel distance, minimal interaction with other people (potential to infect others), as many times as I want, with a high level of sensitivity (high true positive rate) and high specificity (high true negative rate) because I want to help limit the spread of COVID-19 from symptomatic individuals and prevent unnecessary death and hospitalization.
As a student or employee who is required to be tested for COVID-19 every week, I want to be able to complete my test without traveling to or having to schedule an appointment with the testing location. I want to complete my test without interacting with my roommates/family and others on campus/office in case I'm infected. I want to complete my test without the discomfort of sticking a swab up my nose, especially in dry weather. I need the test to be very fast because sometimes I procrastinate and I need the test to be very convenient to fit into my busy schedule.
As a patient in a hospital or care facility, I know I already have been diagnosed with COVID, but I want to leave and get back to normal life as quickly as possible. I want a COVID-19 test that is repeatable without cost, and I need to be able to take the test without violating quarantine. I would appreciate a non-invasive method for daily testing.
As an insurance company, medical provider, or government, I need to limit the spread of COVID-19 to keep medical facilities from being overwhelmed, prevent death and economic hardship, and I need to pay for any testing expense and damage that may result from the virus. I need an accurate COVID-19 test that is cheaper, easier to manufacture and distribute, and effective at stopping the spread of the virus.
As a citizen of a developing nation, I cannot travel to a testing facility and I have not been offered a vaccine. I need a COVID-19 test that is free and accessible to me and others in my community so that we can work together to limit the spread of COVID without the infrastructure or government assistance provided in wealthier countries.
Although the lack of electricity in some countries prevents the poorest citizens from owning or charging a mobile phone. Cell phones, and specifically smartphones are becoming more and more ubiquitous throughout the world.
Image Source (https://www.bankmycell.com/blog/how-many-phones-are-in-the-world)
It is our hope that this product will help those in middle- and low-income countries who have limited access to vaccines and testing infrastructure but may have cell phone or smartphone access. We use this graphic of vaccine access as a proxy for COVID-19 testing access understanding the correlation is not demonstrated.
Image Source (https://www.linkedin.com/in/williamhgates/)
The COUGHVID dataset provides over 25,000 crowdsourced cough recordings representing a wide range of participant ages, genders, geographic locations, and COVID-19 statuses. Four experienced physicians labeled more than 2,800 of the recordings.
Cough
Microphone Device
- COVID-19 status
- location
- age
- gender
- respiratory condition
Homo sapiens
Color-coded map of COVID-19 positive tests and points representing audio sample collections:

Machine-accessible metadata file describing the reported data: https://doi.org/10.6084/m9.figshare.14377019
Open Source Research Paper https://www.nature.com/articles/s41597-021-00937-4
The XGB classifier used to remove non-cough recordings, feature extraction source code, cough preprocessing methods, cough segmentation function, and SNR estimation algorithm are available on a public repository: https://c4science.ch/diffusion/10770/repository
Extreme Gradient Boosting is an open-source library that provides an efficient and effective implementation of the gradient boosting algorithm. It is called gradient boosting because it uses a gradient descent algorithm to minimize loss when adding new models. This approach supports both regression and classification predictive modeling problems.
Figure 1: VGG visualization (https://www.cs.toronto.edu/~frossard/post/vgg16/).
Disadvantages - Takes a long time to train. The model is very large: >1 GB.
Steps_per_epoch and validation_steps were calculated instead of setting a random value. Samples / batch_size. 5515 / 32 = 172.
We chose Adam, with a very small learning rate .000001 because we want to be efficient and sensitive to very small differences in the audio signal spectrograms. Adam = adaptive moment estimation
- Adam is a replacement optimization algorithm for stochastic gradient descent for training deep learning models.
- Adam combines the best properties of the AdaGrad and RMSProp algorithms to provide an optimization algorithm that can handle sparse gradients on noisy problems.
- Adam is relatively easy to configure where the default configuration parameters do well on most problems.
Increase accuracy with ResNet50 instead of VGG16 for training and modeling and use MFCC for spectrogram generation. Rerun on COVIDHACK dataset. Resnet is deeper and produces a much lighter model, i.e. smaller model file size.
https://stackoverflow.com/questions/54207410/how-to-split-resnet50-model-from-top-as-well-as-from-bottom
We are learning more about pytorch to better understand what libraries, tools and/or algorithms may be available to us to help us improve the classification of cough audio samples to diagnose COVID-19 and build our MVP.


