Department of Electrical Engineering, University of Abdelmalek Essaadi, Morocco
Corresponding author details:
Mostafa Derraz
Department of Electrical Engineering
University of AbdelmalekEssaadi
Morocco
Copyright: © 2020 Derraz M. This is an openaccess article distributed under the terms of the Creative Commons Attribution 4.0 international License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
In the presence of this paper, we aim to present the COVID-19-RCC protocol, a protocol
that can reduce the spread of Corona-virus disease COVID-19 by remotely diagnosing of large
people’s groups, or even entire countries, in a parallel manner. The COVID-19-RCC protocol
is an algorithm for recognizing and counting coughs during a phone’s conversation (in real time), where coughing is one of the main symptoms of Coronaviruses. The recognition is
based on the analysis of the audio frequency spectrum during the call but without recording
the content of the call. Based on the coughing, the stage of illness can be predicted and
the probability of transferring the virus to and infecting peoples in the surrounding area
can be reduced. Several studies have shown that human-to-human transmission of the
Corona-viruses has occurred by droplets or direct contact, which shows us the importance
of detecting patients who complain of coughing as a priority, in order to limit the spread,
as coughing is the main factor behind the droplets. In general, peoples who complain of
coughing can be considered to be at the origin of the spread of the virus. This protocol may
not be the most effective, but COVID-19-RCC can be ready to use, executable and functional
within 24 hours. Especially under these circumstances, we don’t have enough time to
develop a sophisticated solution!
COVID-19; Coronavirus; Remotely diagnose; Detecting coughing; Audio Frequency
Spectrum
COVID-19-RCC protocol
The idea behind this concept is based on an old concept that said a package of halfsolutions can perform as an effective solution. Remotely diagnose the virus by recognizing and counting of coughs during phone calls or even by installing a phone’s application that activated on the background, isn’t the perfect solution, also isn’t the all-in-one solution, but we encourage the authorities to add this protocol on the existed package of solutions to strengthen the control’s system since we have not yet reached the right treatment.
In China, they used drones to measure the temperature in the streets of a randomly selected group of people, and the Chinese never said how many we can scan from more than a billion people with drones? Definitely the amount of data is not enough, from the first moment the idea seemed useless and there was no need to apply it in the ground. In on other hand and so far, the Chinese have managed to reach the peak and have started to reduce the reproducibility of the virus while limiting its spread. At present, the virus continues to accelerate its spread in Europe and around the world.
Under these circumstances, many countries can’t develop the same system that china used it in a short time, we have not the time! We suggesting to focus on the second symptom of the virus is the cough in the side of the fever, but the advantage of tracking the cough can be without the need to be on the ground nor on-air with drones to measure the temperature (that confirms the fever), in fact, you should be in telecom cables! Due to the Maxwell equations and linear algebra, the same cable can transmit the millions of data, audio and calls through it, in a parallel manner, without the interference, So let’s use this advantage and install a small system (within 24h) to analyzing the audio frequency spectrum, that system has already existed. The system automatically starts working when a phone’s call starts and recognizing and counting of coughs during the call.
You may think that cough detection is less effective than temperature measurement? But let’s present some facts about the Corona-virus, the virus is transmitting only by droplets! and the main actor behind the droplets is the coughing more than the fever, however, the following paragraphs are detected to present and explain the importance of basing on the cough as a first diagnosis.
The spread of the virus is growing exponentially, so in order to control it, we must follow an exponential procedure too. The detection of coughing during phone calls gives us the same advantage of exponential growth because the call is between two people, so an action of anyone gives the state of two people in parallel. Moreover, to limit the virus, we must work on a large circle of probability and exclude unconfirmed cases, but rather rely on confirmed cases and investigate with patients to predict other inflected cases.
The quality of the system’s predictions will increase over time thanks to the machine learning mechanisms, by classifying the caller that coughing on the grey list, after detecting the cough in a second call, a robot will call the caller and will ask him if he has claimed the symptoms of the virus, if yes, the caller will click 1 to react with the robot, then the caller will be classified on the blacklist if-else, the machine learning mechanisms will learn from this case to improve the classification.
Please note that this article is not a medical article or comes from a biology expert, we are simply trying to contribute what we can do, we do not intend to compete with professionals in their field. You will find below some probability models; they are not the right ones! We suggested it just to help explain the idea, they are not appropriate models! due to a lack of time. Also, due to a lack of time and sources, you will find a direct quote from other articles. I hope that there will be no problems with the original authors since we don’t tend to have negatives intentions.
Coronavirus COVID-19
Since the onset of infection with the new coronavirus COVID-19 in Wuhan, China, in December 2019, it has spread rapidly in China and many other countries. To date, the new coronavirus has affected more than 145,798 confirmed patients (5,531 reported deaths and 67,003 recoveries) and has become a major global health concern.
As well as studies have reported a link between a local fish and wildlife market (Wuhan City) and most cases of infection, which indicate possible transmission from animals to humans, more and more studies have demonstrated human-to-human transmission of “COVID-19” by droplets or by direct contact.
The accelerated spread of the virus through human-to-human transmission has created an urgent need to develop and approve standard treatment protocols. Besides the lack of complete details on the structure and life cycle of the virus, therapeutic development is delayed, preventive measures remain the only procedure to limit the spread of COVID-19.
Few existing drugs have been evaluated for the treatment of COVID-19 and have shown promising good results in clinical applications. The chemicals used to “manage the symptoms of viral infection” have helped several patients in the early stages of their recovery.
To date, there is no known fully effective treatment for COVID-19.
However, potential therapies are emerging as the clinical evaluation
of existing antiviral drugs continues and as knowledge about this
new coronavirus progresses.
Table 1: Clinical manifestation from three study site, Wuhan[1]
Figure 1: COVID-19 spread from 21 January to 11 February, Wuhan [1].
Figure 2: Flowchart of the tests[3].
Figure 3: Example of a male, 74 years old with fever and cough for
5 days. Axial chest CT showed bilateral subpleural ground glass
opacities (GGO)
Figure 4: Example of a female, 55 years old, with fever and cough
for 7 days. Axial chest CT showed extensive bilateral ground glass
opacity and consolidation [3].
Figure 5: Example of a male, 43 years old, presenting with fever
and cough for 1 week. Axial chest CT shows small bilateral are as
of peripheral GGO with minimal consolidation [3].
Figure 6: Example of a female, 43 years old presenting with fever with cough for 5 days. Axial chest CT shows the right lung region of peripheral consolidation[3].
Figure 7: Example of a male, 36 years old with cough for 3 days.
Axial chest CT shows a small focal and central ground glass opacity
(GGO) in the right upper lobe [3].
Development of a cough recording system required as an essential first step is to clearly define the definition of cough. As the definition is determined by the modalities to be measured, a classical definition of cough consists of three phases:
These phases can only be really appreciated if one monitors the flow, glottis movements and muscle activity which, although possible in the laboratory, are currently not practical in the remote measurement of spontaneous cough[4].
The pattern of the cough
It has been shown that the contraction of the expiratory muscles against the closed glottis, followed by the sudden opening of the glottis, generates particularly high flow rates. These “supramaximal flow rates” are higher than those observed on a standard maximum expiratory flow-volume curve and generate the characteristic sound we associate with coughing. This sound is often known as explosive or expulsive sound, with a chaotic and noisy waveform,(Figure 10) [4].
After this explosive sound, the amplitude of the sound decreases, which is called the intermediate phase, and finally, some coughs also contain a third vocal phase. This vocal phase is thought to be due to a second partial closure of the vocal cords which vibrate, producing a regular, periodic waveform similar to the vowels of speech (see Figure 10) [4].
Cough rarely occurs in isolation, especially in patients with chronic cough as is the case with COVID-19 Coronavirus. In the experience of these authors, one of the most common patterns is an explosive pair of sounds following a single breath. In many patients, prolonged trains of explosive sounds occur following a single breath. The terminology used to describe these episodes varies and includes coughs, spells, bursts or attacks.
From cough sound recordings containing the described waveforms, it is possible to extract a number of different cough characteristics. The most obvious parameter is the quantification of the number of coughs, but in addition, the intensity and quality of the cough sounds can provide other important information for remote diagnosis.
Cough frequency: Although cough is a very common symptom, until recently we knew remarkably little about the frequency of cough in patients with different conditions, nor is there a universally accepted method to quantify cough. The most intuitive way to count coughs is to count the number of explosive coughs. We have also experimented with counting the time spent coughing, the number of seconds per hour containing at least one explosive sound. The authors found that there is a strong linear relationship between the number of cough sounds and the time spent coughing. This seems to be a key element in defining the frequency of coughing, we believe that we can define this linear function using neural networks on large datasets of different people coughing, in particular we focus on defining a single disease, which is the Covid-19 Coronavirus (Figure 11).
Cough periods can be defined in at least two different ways:
For the first definition, it is necessary to be able to detect inspiratory phases in addition to coughing noises. We have compared the last definition, which consists of counting the explosive cough sounds and the time spent coughing. Coughing times are slightly less well correlated with other cough units, because the length of the time is not taken into account. In theory, if an intervention shortened the length of the epoch rather than reducing the number of epochs, this method would not be detected. [4].
Cough intensity: Cough intensity has been shown to be a key component of cough severity for patients, assessed as discrete in relation to cough frequency. Intense cough has been described as a “hard”, “deep” or “severe” cough, sometimes associated with physical effects such as pain, discomfort and vomiting.Indeed, the most intense and therefore violent cough is likely to lead to more extreme physical complications such as broken ribs, hernias and syncope, but obtaining an objective measure of cough intensity is complex. It cannot be assumed that the strongest coughs are necessarilythemost intense coughs for patients. In addition, ifthe recording is made from a lapel microphone, the intensity is affected by several factors, including the distance between the mouth and the microphone. But fortunately, here we are trying to study a single disease, COVID-19, and it is easy to get a huge data set to help the neutral network learn quickly.
Physiological measurements during voluntary coughing can quantify the mechanical changes that occur during coughing, but there is little data to clarify the relationship between a patient’s perception of intensity and these parameters and the sound of the cough if any. Recent studies have investigated muscle activation, flow rate and pressures generated during voluntary coughing in healthy volunteers. Subjects were asked to cough at three different levels of intensity but from fixed lung volumes. They found that all parameters increased significantly with cough intensity and that cough intensity was also correlated with some cough sound parameters (unpublished data), raising the possibility that a surrogate measure of cough intensity could be derived from cough sound recordings. Further research is needed to better understand the concept of cough intensity in patients and whether an objective measurement of cough intensity can be performed non-invasively and in an ambulatory setting. But we like to repeat what we said before about the possibilities to recognized in case if we are studying one disease in large data sets.
Cough quality: It is possible that useful information can be obtained from the quality of a patient’s cough sounds. It is clear that clinicians who listen to cough sounds are able to distinguish coughs with sputum in the airway from dry coughs, but are less able to identify wheezing coughs or the underlying diagnosis of cough sounds. Publications from Korpas have already suggested that the study of voluntary cough noises or “tussophonography” may be useful in diagnosing respiratory disease, although the validity of these measures hasnot been fully established. However, more recent work combining voluntary cough sounds with flow measurements suggests that certain sound characteristics can predict abnormalities in lung function and the Gates Foundation has recently funded a project to diagnose respiratory disease from voluntary coughs collected by mobile phone. They seem to be a good partner to carry out the protocol!
One of the potential difficulties in making diagnoses from spontaneous cough recordings is the variability of sound components both within and between diagnostic groups. However, it is possible to quantify characteristics such as the proportion of cough with sputum in the airway or wheezing, and this may be useful if representative sound characteristics can be identified and validated[4].
The methods of hull automated cough counter (HACC)
The method, hull automatic cough counter (HACC), works in three steps[5].
Software: All software was developed under Matlab. The following Matlab toolboxes were used: PLS Toolbox version, Signal processing toolbox, Neural network toolbox, and Voicebox[5].
The first step:The audio recording is initially converted into a 44.1 kHz 16 bit mono Microsoft digital wave file. For this process, the sound recordings are analyzed at a sampling frequency of 11.025 kHz. The signal is then analyzed using the moving windowed signal standard deviation σ signal ,i.e. the standard deviation as a function of time. The moving window works along the entire length of the audio signal, taking each frame as the center of a new window. This windowed standard deviation is similar to the more commonly used root mean square signal however, it corrects for deviations of the mean from zero. Portions of the signal containing no sound events will show a reasonably constant background signal (baseline) with small deviation relating to the inherent noise present in the signal. A sound event will cause the signal to rise above the baseline with a magnitude proportional to the validity of the signal. The moving window technique ensures the standard deviation of the background signal is not fixed forthe duration of the signal; instead σ backgroud at time t is calculated as the minimum σ signal between the start of the window,t - ∆tbackground ) and the end of the window, (t - ∆tbackground ). Sound events are thus detected when σ signal for a particular window exceeds the threshold value, thresh peak ,multiplied by σ background for that window. Although this procedure means that sound sensitivity varies to a certain extent, it allows for peak detection in noisy backgrounds. The start and end values of a sound event are defined as the nearest σ signal before and after the peak maximum which is below the defined low level calculated by
peak thresh × σ background . Portions of the signal that are below this low level are removed and excluded from further analysis (Figure 12). The amount of noise within the section of the signal is then reduced by smoothing. The standard deviations for each frame in the section are plotted and treated as a series of peaks. Peaks with variations lower than the noise-level are removed. The remaining frames of the signal are compiled for signal processing[5].
The second step is the characterization of sound events using a signal processing step as shown in Figure 14 (i to k). The sound events identified by analysis of the signal are then characterized. Each window undergoes a parameter measurement step in which a set of parameters is determined and combined into a test pattern (termed a feature vector). Because windowing is used, multiple test patterns are created for a single sound event. These test patterns are compared with a set of Ntrain reference patterns for which the cough/non-cough classification is known. Depending on whether the test patterns are more similar to the cough or the non-cough reference patterns the corresponding sound event is classified as a cough or non-cough event respectively [5].
The third step is pattern comparison and decision-making as shown in Figure 14 (l to o). For this HACC uses a PNN. This network provides a general solution to pattern classification problems by following a Bayesian classifiers approach. The PNN stores the reference patterns. Instead of classifying single patterns, HACC classifies complete sound events. The ρ k values for all test patterns belonging to the sound event are summed yielding a sum of probabilities ~ρ k for each class k. The sound event is classified as a member of the class with the largest ~ρ k [5].
Creation of the reference patterns
Sound recordings of N subjects are used to create a set of M cough
patterns and M non-cough patterns. The first step is to identify the appropriate cough and noncough events in all N recordings. Adequacy is determined by the
clarity of the sound and its ability to add relevant variations to
the data set.Non-cough events are sounds present in the audio
recording that are not coughs. These events are combined in
an Xcough pattern matrix and an Xnon cough pattern matrix [5].
The length of feature vectors in these matrices is reduced by
performing principal component analysis (PCA). The combined Xcough , Xnon cough matrix is first scaled automatically and then, as
defined by the PCA, only scores that describe more than 0.5% of the
variance are used. The experimental data are scaled using the means
and variances of the baseline data and projected to the principal
component space using a projection matrix. The reference models
used for the creation of the NNLP are obtained by performing two k-means clustering of approximately 10,000 cough and non-cough models. The first 10,000 patterns are selected from the Xcough and Xnon cough patterns. The reference patterns are then passed into the
NDP for future classification of cough and non-cough patterns, see
(Figure 12-14) (Table 2).
Figure 8: Example of a female, 40 years old. Axial chest CT shows
small peripheral linear opacity bilaterally [3].
Figure 9: Example of a male, 31 years old with fever for 1 day. Axial
chest CT shows a linear opacity in the left lower lateral mid lung[3].
Figure 10: Typical cough waveform showing three phases of the
sound. Insets show magnification of A explosive sound which is
irregular and noise-like and B voiced phase which is regular and
periodic[4].
Figure 11: Patterns of coughing. (A) Pair of cough sounds and (B)
Cough epoch containing multiple explosive phases [5].
Figure 12: Sound detection. The top graph shows the original
sound signal. In the bottom graph depicts σ signal and the two
baseline threshold lines in which threshpeak = 10 and thresh limits =
1.5. Point 2(a) indicates the first standard deviation larger than thresh peak .σbackgroud Points 2(b) and 2(c) are the points nearest
to point 2(a) where σ signal is smaller than thresh limits,σbackgroud.The
whole region between points 2(b) and 2(c) is a sound event. In the
same way, the region between points 2(d) and 2(e) will be detected
as a sound event [5]
Figure 13:Graphical User Interface (GUI) for human listener [5].
Figure 14: Pattern Recognition Approach to cough and non-cough classification[5].
Table 2:Symbols used and their settings [5]
Copyright © 2020 Boffin Access Limited.