200px | |
The way to use hearing aid application |
---|
Hearing aid application (HAA) is software which, when installed on a mobile computational platform, helps with hearing.[1] Mobile devices may include smartphones, tablets or smart watch.
As operational characteristics are adjusted directly through the graphic interface of the application, this feature allows classifying the hardware-software complex as a programmable hearing aid.[2]
HAA, as a rule, adjusts the level of the surrounding acoustic environment (sound) to the user's hearing characteristics, thereby allowing him to hear better.[3][4][5][6][7][4] Most of HAA works both with wired and bluetooth headsets/headphones.[6][7][4][8][9][10]
Unlike traditional hearing aid, which is a part of system consisting of a hearing aid, wired or wireless interworking interface, computer device and installed software for changes,[2] adjustment of HAA is a procedure within the united hardware-software complex.
Hearing aid applications | Traditional Hearing aids | |
---|---|---|
Channels | Up to 256 | 15-111 |
Sample rate | Maximum 44 kHz | Maximum 14 kHz |
Programmable hearing aid | Yes (done by user) | Yes (done by specialist) |
In-built hearing test | Yes | Yes (limited) |
Hearing test time | A few minutes (by the user) | 30 minutes - 60 minutes (several times) |
Effects of anti stigmatization | Yes | No, except for intra channels (CIS) |
Audio recorder + Speech recognition in text | Yes | No |
Remote microphone option without additional devices | Yes | No |
Binaural correction of both ears | Yes | No |
Gain formula, that takes into account the upper threshold of perception | Yes | No |
Adjustable noise supppression | Yes | Yes |
Ecosystem of assistive applications (radio, music player, etc.) | Yes | No |
Built into app course of adaptation to hearing aid | Yes | No |
Online gain formula change | Yes | No |
Amplification of quiet sounds (dynamic compression - WDRC) | Yes | No |
Batteries | Built-in, rechargeable | Rechargeable and replaceable |
Thus, HAA is not inferior, and even surpasses traditional hearing aids in some characteristics (number of channels, sampling frequency etc.).
The basic hearing aid setting is amplification adjustment in accordance with the user's audiogram.
The process of selection of traditional hearing aid starts with audiometry, which is also the first characteristic of sound perception disorder considered during the adjustment of HAA. If the user has already had a special audiologic checkup, this type of adjustment can be done remotely by a specialist, and the results of this checkup can be entered by the user with the help of the application's graphic interface. A lot of HAA have a built-in procedure of in situ-audiometry which automates the whole process so that the user can take this type of examination on their own. Software-based generators of tone signals and interface elements for reaction to exceeding the hearing perception threshold are used for that.
Quick change of settings, such as recruitment compensation, noise suppression, amplification regulation allows HAA users to choose the settings which are more suitable to understanding the speech in silence or with a background noise.
An additional feature of HAA is ability to choose and apply the sets of parameters most suitable for the current acoustic situation, for example, for silence, for talking in a noisy environment, etc.
Some HAA provide for using different computing formulas for calculation of target amplification on the basis of audiometry data. These formulas are intended to amplify the speech up to the maximum comfortable level of perception by the user.[2]
In particular, Pertalex HAA offers its users 3 well-known formulas:
When using microphone equipment of phone headsets, maximum available amplification is limited by appearance of acoustic feedback between the microphone and the speaker. Increase of possible level of signal amplification is ensured by stronger suppression of acoustic feedback.[14]
Acoustic feedback is the most widespread option of feedback appearing at the return leakage of sound from the speaker to the microphone. This can be caused by small distance between the microphone and the speaker, loose fit of an earpiece to the surface of acoustic meatus and so on.
The processing under frequency-dependent amplification of input signal for compensation of hearing impairment includes assistive functions, such as acoustic feedback suppression.[2]
In a number of HAA a scheme with subband signal decomposition is used for acoustic feedback suppression.[15]
Compared to traditional hearing aids, HAA has the following disadvantages:
At the same time, HAAs has a number of great advantages:
Of the 11 apps tested in the hearing assistant category, all 11 apps were still accessible at the end of the scoring period. The best app in the hearing assistant category was Petralex Hearing Aid (4.3/5). [16]
Distribution of HAA is limited by the infrastructure of specialized application stores, such as App Store, Google Play, etc. There is a fairly large number of applications that implements a hearing aid based on a smartphone/tablet. However, despite the general idea - hearing aid, they all differ in a number of criteria.
For benchmarking, the following applications were selected from the top 10 Google Play store applications (for Android devices) and the App Store (for iOS devices), selected on the "Hearing aid" request, and meet the following criteria:
Comparative characteristics of hearing aid applications presented on the market are presented in the following table:[17][18]
Petralex |
uSound (Hearing Assistant) | Hearing Aid Sound Amplifier |
Fennex
|
Ear Spy |
Jacoti ListenApp |
BoiAid |
AmplyPhone |
Dectone |
Listening device - Hearing aid | Google
Sound Amplifier | |
---|---|---|---|---|---|---|---|---|---|---|---|
Latest release | January 2019 (iOS), January 2019 (Android) |
November 2019 (iOS), January 2019 (Android) |
December 2018 (iOS) | December 2018 (iOS) | June 2018 (iOS), October 2018 (Android) |
October 2018 (iOS) | February 2015 (iOS) | April 2017 (iOS) | October 2018 (Android) |
July 2019 (iOS) | July 2019 (Android) |
Audio latency | 20 ms*** (iOS), 65 ms*** (Android) |
30 ms***
(iOS), (Android) |
30 ms***
(iOS) |
45 ms***
(iOS) |
35 ms*** (iOS), 360 ms*** (Android) |
20 ms***
(iOS) |
30 ms*** (iOS) | 35 ms***
(iOS) |
65 ms*** (Android) | 30 ms*** (iOS) | |
Programmable
hearing aid |
Yes | Yes | Yes | Yes | No | Yes | No | No | Yes | Yes | No |
In-built hearing test | Yes | Yes | No | Yes | No | Yes***** | No | No | Yes | Yes | No |
Automatic/manual
audiometry |
Automatic and manual | Automatic and manual | Manual | Automatic and manual | No | Automatic and manual | No | No | Automatic and manual | Automatic and manual | No |
Nonlinear hearing aid | Yes | No | No | No | No | No | No | No | Yes | Yes | No |
Amplification of quiet
sounds (dynamic compression - WDRC) |
Yes | No | No | Yes | No | No | No | No | Yes | Yes | Yes |
Adjustment of WDRC | Yes | No | No | Yes | No | No | No | No | Yes | Yes | Yes |
Online gain formula change | Yes | No | No | No | No | No | No | No | Yes | Yes | No |
Ability to adapt to
the environment |
Yes | Yes | Yes | Yes | No | Yes | Yes | No | Yes | Yes | No |
Adjustable noise
suppression |
Yes | No | Yes | Yes | No | No | Yes | No | Yes | Yes | Yes |
Suppression of acoustic
feedback |
Yes | No | No | No | No | No | No | No | Yes | Yes | No |
Bluetooth headset
support |
Yes, on iOS and Android | Yes, on iOS and Android | Yes, only on iOS | Yes, only on iOS | Yes, on iOS
and Android**** |
No | Yes, only on iOS | No | Yes | Yes | No |
Audio recorder | Yes | No | No | No | Yes**** | No | No | Yes | Yes | Yes | No |
Speech recognition
in text |
Yes, only
on iOS |
No | No | No | No | No | No | No | No | Yes | No |
Volume balance reconstruction
of the left/right ear |
No | No | Yes | Yes | No | No | No | No | Yes | Yes | Yes |
Gain formula, that takes
into account the upper thresholds of perception |
Yes | No | No | No | No | No | No | No | Yes | Yes | No |
Ecosystem of assistive applications | Yes | No | No | No | No | No | No | No | Yes | Yes | No |
Built into course of
adaptation to hearing aid application |
Yes | No | No | No | No | No | No | No | Yes | No | No |
Special gain formula
for tinnitus |
Yes | No | No | No | No | No | No | No | Yes | Yes | No |
Ratings | 4.7 on AppStore, 4.0 on Google Play | 3.7 on Google Play | 4.4 on AppStore | No | 3.1 on AppStore, 3.7 on Google Play | No | No | No | 3.7 on Google Play | 4.6 on AppStore | 3.7 on Google Play |
Notes: *tested on iPhone 6+ (iOS 9.2), ** tested on Samsung Galaxy A3 (Android 7.0), *** on the date of testing (11 February 2019 ), **** in the paid version, ***** - with the help of an additional application.
The principles of working HAA are similar to those of traditional hearing aids.
Most HAA provides two modes: settings mode (passing through the in situ-audiometry procedure) and the hearing correction mode.
Setup mode is an in situ-audiometry procedure that allows the user to independently measure hearing thresholds using tone audio signals that are generated with a gradually increasing amplitude over a period of some seconds. Audio signals are generated according to the following sequence of frequencies: 125, 250, 500, 1000, 2000, 4000, 6000 and 8000 Hz.
Some HAA do not have an integrated audiometry system. In this case, the adjustment of the sound amplification level (similar to the equalizer) is made by the user based on their own subjective feelings.[9][10][19][20]
Hearing correction mode represents an audio signal processing system. The audio signal processing system implements a broadband method for changing the correction of the spectral envelope of a signal using a filter with a finite impulse response whose frequency response is generated based on user-defined hearing thresholds during the in situ-audiometry procedure.
Figure 2 shows a general signal processing scheme in a hearing aid application.
Audio input signal, acoustic feedback (echo) and background noise are captured by the microphone, summed and then divided into sub-band components with a lower sampling rate using an analysis filter bank (AFB).
Estimation of noise is based on the minima controlled recursive averaging of past values of noise.[21]
Cleared of noise subband signal is cleared of acoustic echo by adaptive filtering.[21]
The subband audio components that are cleared of echo and noise are amplified by multiplying by the corresponding coefficients, which are calculated based on the level of input and output audio signals, ambient noise energy, as well as hearing thresholds (hearing loss frequency characteristics) of the user.
The gain unit also performs the function of dynamic range compression, thereby compensating for the function of non-linear amplification of the human cochlea.
The processed broadband signal is synthesized using a synthesis filter bank (SFB).
AFB and SFB are can be realised as DFT-modulated filter banks, which is one of the most popular filter bank type used in modern hearing aids.[21]
The output signal can be multiplied by the total gain, which provides a comfortable sound level. This coefficient is adjusted by the user using an external controller directly in HAA interface.[9][5][6][7]
HAA, as a rule, provides high speed (i.e. minimum sound delay) and high sound quality due to a simple signal processing algorithm as well as due to the effective implementation of application functional blocks.[21]
Some HAA may not have an acoustic cancellation block.[22]
Based on the results of studies conducted on the effectiveness of using the different hearing aid applications, it can be concluded that for those respondents who have never used hearing aids before, there is a tendency of a positive effect on speech intelligibility. The positive impact on speech intelligibility when talking in a noisy environment was noted by those respondents who used hearing aids.[23]
HAA also can be useful not only as a hearing aid. For example, it can be useful in the process of studying, as students can place their smartphone/tablet closer to the teacher and hears him better.[8]