A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2022; you can also visit the original URL.
The file type is application/pdf
.
Filters
Hear The Flow: Optical Flow-Based Self-Supervised Visual Sound Source Localization
[article]
2022
arXiv
pre-print
We further demonstrate that the addition of flow-based attention substantially improves visual sound source localization. ...
In this work, we capture this characteristic by modeling the optical flow in a video as a prior to better aid in localizing the sound source. ...
Acknowledgements: This work was supported by the Center for Identification Technology Research (CITeR) and the National Science Foundation (NSF) under grant #1822190. ...
arXiv:2211.03019v1
fatcat:wvpcdnek6jesfpvdpfjq4lnsyi
Vision-guided robot hearing
2014
The international journal of robotics research
The results we obtained validate the approach and encourage us to further investigate how vision can help robot hearing. ...
Indeed, the deterministic component allows us to map the visual information into the auditory space. ...
Acknowledgments This work was partially funded by the HUMAVIPS FP7 European Project FP7-ICT-247525. ...
doi:10.1177/0278364914548050
fatcat:onjyr7y2jzfhxiytcgjoaeicei
Fine‐structure processing, frequency selectivity and speech perception in hearing‐impaired listeners
2008
Journal of the Acoustical Society of America
American English (AE) speech sounds by adult learners of English. ...
Listeners are sensitive to the acoustic characteristics of consonant reduction, but they are also very skilled at evaluating variability along the acoustic dimensions that realize reduction. ...
Initially these arrays were intended for sound source localization and natural hearing restoration ͑where the hearing of a user whose ears are obstructed by an encapsulating helmet or headset is restored͒ ...
doi:10.1121/1.2935148
fatcat:nqyyia5pubamnhqgonegghrudm
Amplitude modulation depth discrimination in hearing‐impaired and normal‐hearing listeners
2008
Journal of the Acoustical Society of America
Can also diffracted sound be handled as flow of particles? Some new results of a beam tracing approach based on the uncertainty principle. Uwe M. ...
materials under the posts base. ...
The hearing data were collected by using the AEP method. An airgun was chosen as sound source for the fatiguing sound stimulus to simulate the impulsive sounds at sufficiently high levels. ...
doi:10.1121/1.2935715
fatcat:qsqohnv63fdsjgegqb2h5s7r7q
New ISO standards for hearing protectors
2000
Journal of the Acoustical Society of America
response to the interaction of waves and currents, using sound backscattered by the sediments entrained by the flow. ...
, or be fundamentally associated with, the actual sound sources. ...
This feature can be used to solve the ''permutation problem'' of frequency-domain-based blind source separation algorithms. ...
doi:10.1121/1.4743748
fatcat:tzupe2dywvdlba4cl35xczgrqq
Hearing Impairment and Traumatic Brain Injury among Soldiers: Special Considerations for the Audiologist
2009
Seminars in Hearing
Blast-related injuries may damage the auditory processing and/or balance centers resulting in hearing loss, dizziness, tinnitus, and/or central auditory processing disorders. ...
Some PCS symptoms such as dizziness, loss of balance, hearing difficulty, and noise sensitivity also can signify auditory or vestibular dysfunction and should not be obscured with the PCS package. ...
sources of injury. 78 TBI may damage the visual cortex and/or visual pathways that connect the eyes to the cortical visual centers. ...
doi:10.1055/s-0028-1111103
fatcat:s7nn7inqzrfwdcmzk6w4uxwkny
Multimodal Urban Scene Understanding
2022
Zenodo
More recent deep learning-based methods focus on learning semantic audiovisual representations in a self-supervised manner and using them for localizing sounding objects. ...
An analysis of the strengths and weaknesses of our methods helps us better understand the problem of visual sound source localization and sheds new light on the characteristics of our dataset. ...
Chapter 2 starts with a general overview of self-supervised representation learning and then presents a review of the state-of-the-art in visual sound source localization. ...
doi:10.5281/zenodo.7116361
fatcat:spidpgfdajdstmqevkkurad4xq
Quantitative assessment of spatial sound distortion by the semi-ideal recording point of a hear-through device
2013
Journal of the Acoustical Society of America
This involves estimating the scattering area at each sounding based on local seafloor slopes. ...
Our proposal improves localization accuracy for sound sources reproduced by horizontal loudspeaker arrays. ...
is utilized on the sound localization in the median plane. ...
doi:10.1121/1.4805375
fatcat:u4bvxh6karet3avpjdhpfwqpf4
FlowGrad: Using Motion for Visual Sound Source Localization
[article]
2022
arXiv
pre-print
Most recent work in visual sound source localization relies on semantic audio-visual representations learned in a self-supervised manner, and by design excludes temporal information present in videos. ...
This work introduces temporal context into the state-of-the-art methods for sound source localization in urban scenes using optical flow as a means to encode motion information. ...
These methods focus on learning semantic auditory and visual representations in a self-supervised manner that enables sound source localization (SSL) via the similarity between audio and visual embeddings ...
arXiv:2211.08367v1
fatcat:eq3vshoi25f2bedftqgbnoygxy
Randomised controlled feasibility trial of the Active Communication Education programme plus hearing aid provision versus hearing aid provision alone (ACE to HEAR): a study protocol
2018
BMJ Open
These will be sourced from a combination of local costings and national databases. 64 The costing approach will take a broad analytical perspective accounting for NHS costs and for those observed by ...
Downloaded from
Figure 1 1 ACE to HEAR study flow diagram. ...
doi:10.1136/bmjopen-2018-021502
pmid:30068614
pmcid:PMC6074637
fatcat:hobbgn6qfvg2hcjydv76vcs5uq
Experimental investigation of the effect of middle ear in bone conduction
2020
Hearing Research
This was based on sequential measurements of the 3D velocity of the stapes footplate and the promontory. ...
In parallel, the differential tympanic membrane (TM) pressure was recorded by measuring sound pressure in the middle ear and in the external auditory canal each measured 1-2 mm from the TM. ...
The orientation of the optical axis (Z axis) of 3D LDV was visually adjusted to be approximately normal to the skull surface. ...
doi:10.1016/j.heares.2020.108041
pmid:32810722
fatcat:a3xfc34mpnbxdj4jobwpraam2u
No Evidence That Frontal Optical Flow Affects Perceived Locomotor Speed and Locomotor Biomechanics When Running on a Treadmill
2019
Applied Sciences
In Experiment 2, 20 healthy participants ran at a previously self-selected constant speed while being presented with different optical flow conditions (see Experiment 1). ...
slower/faster optical flow. ...
response device, and Thibaut Le Naour (Department of Neuroscience and Movement Science, University of Fribourg, Fribourg, Switzerland) for his help in the creation of the representation of the experimental ...
doi:10.3390/app9214589
fatcat:uteipjhhnfetzpwo27gmmf4pme
Self-Supervised Learning of Audio-Visual Objects from Video
[article]
2020
arXiv
pre-print
To this end, we introduce a model that uses attention to localize and group sound sources, and optical flow to aggregate information over time. ...
We demonstrate the effectiveness of the audio-visual object embeddings that our model learns by using them for four downstream speech-oriented tasks: (a) multi-speaker sound source separation, (b) localizing ...
Kalogeiton for generous help with the annotations and the Friends videos, A. A. Efros for helpful discussions, L. Momeni, T. Han and Q. Pleple for proofreading, A. Dutta for help with VIA, and A. ...
arXiv:2008.04237v1
fatcat:6qs4sxx3qfgzdcr77zlw7zzyvi
The Sound of Motions
[article]
2019
arXiv
pre-print
Inspired by the fact that humans is capable of interpreting sound sources from how objects move visually, we propose a novel system that explicitly captures such motion cues for the task of sound localization ...
Quantitative and qualitative evaluations show that comparing to previous models that rely on visual appearance cues, our motion based system improves performance in separating musical instrument sounds ...
Given the recent advances on CNN-based optical flow estimation, we incorporate a state-of-the-art optical flow model PWC-Net [44] into our system. ...
arXiv:1904.05979v1
fatcat:tbjwa6uoorgrnouke5tjcyryny
The role of extended preoperative steroids in hearing preservation cochlear implantation
2015
Hearing Research
The second aim is to examine the role of extended preoperative systemic steroids in hearing preservation CI in an animal model. ...
In addition, the pure tone average (PTA) and hearing preservation rate was calculated. All patients received the same electrode. -v - ...
Residents and fellows differed in their ability to insert the electrode under supervision. ...
doi:10.1016/j.heares.2015.06.010
pmid:26117408
fatcat:jndj6sxkl5b2jikm6x7gfaaf3y
« Previous
Showing results 1 — 15 out of 3,724 results