Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Filters








3,724 Hits in 8.2 sec

Hear The Flow: Optical Flow-Based Self-Supervised Visual Sound Source Localization [article]

Dennis Fedorishin, Deen Dayal Mohan, Bhavin Jawade, Srirangaraj Setlur, Venu Govindaraju
2022 arXiv   pre-print
We further demonstrate that the addition of flow-based attention substantially improves visual sound source localization.  ...  In this work, we capture this characteristic by modeling the optical flow in a video as a prior to better aid in localizing the sound source.  ...  Acknowledgements: This work was supported by the Center for Identification Technology Research (CITeR) and the National Science Foundation (NSF) under grant #1822190.  ... 
arXiv:2211.03019v1 fatcat:wvpcdnek6jesfpvdpfjq4lnsyi

Vision-guided robot hearing

Xavier Alameda-Pineda, Radu Horaud
2014 The international journal of robotics research  
The results we obtained validate the approach and encourage us to further investigate how vision can help robot hearing.  ...  Indeed, the deterministic component allows us to map the visual information into the auditory space.  ...  Acknowledgments This work was partially funded by the HUMAVIPS FP7 European Project FP7-ICT-247525.  ... 
doi:10.1177/0278364914548050 fatcat:onjyr7y2jzfhxiytcgjoaeicei

Fine‐structure processing, frequency selectivity and speech perception in hearing‐impaired listeners

Olaf Strelcyk, Torsten Dau
2008 Journal of the Acoustical Society of America  
American English (AE) speech sounds by adult learners of English.  ...  Listeners are sensitive to the acoustic characteristics of consonant reduction, but they are also very skilled at evaluating variability along the acoustic dimensions that realize reduction.  ...  Initially these arrays were intended for sound source localization and natural hearing restoration ͑where the hearing of a user whose ears are obstructed by an encapsulating helmet or headset is restored͒  ... 
doi:10.1121/1.2935148 fatcat:nqyyia5pubamnhqgonegghrudm

Amplitude modulation depth discrimination in hearing‐impaired and normal‐hearing listeners

Stephan D. Ewert, Jutta Volmer, Torsten Dau, Jesko Verhey
2008 Journal of the Acoustical Society of America  
Can also diffracted sound be handled as flow of particles? Some new results of a beam tracing approach based on the uncertainty principle. Uwe M.  ...  materials under the posts base.  ...  The hearing data were collected by using the AEP method. An airgun was chosen as sound source for the fatiguing sound stimulus to simulate the impulsive sounds at sufficiently high levels.  ... 
doi:10.1121/1.2935715 fatcat:qsqohnv63fdsjgegqb2h5s7r7q

New ISO standards for hearing protectors

Torben Poulsen
2000 Journal of the Acoustical Society of America  
response to the interaction of waves and currents, using sound backscattered by the sediments entrained by the flow.  ...  , or be fundamentally associated with, the actual sound sources.  ...  This feature can be used to solve the ''permutation problem'' of frequency-domain-based blind source separation algorithms.  ... 
doi:10.1121/1.4743748 fatcat:tzupe2dywvdlba4cl35xczgrqq

Hearing Impairment and Traumatic Brain Injury among Soldiers: Special Considerations for the Audiologist

Paula Myers, Debra Wilmington, Frederick Gallun, James Henry, Stephen Fausti
2009 Seminars in Hearing  
Blast-related injuries may damage the auditory processing and/or balance centers resulting in hearing loss, dizziness, tinnitus, and/or central auditory processing disorders.  ...  Some PCS symptoms such as dizziness, loss of balance, hearing difficulty, and noise sensitivity also can signify auditory or vestibular dysfunction and should not be obscured with the PCS package.  ...  sources of injury. 78 TBI may damage the visual cortex and/or visual pathways that connect the eyes to the cortical visual centers.  ... 
doi:10.1055/s-0028-1111103 fatcat:s7nn7inqzrfwdcmzk6w4uxwkny

Multimodal Urban Scene Understanding

Rajsuryan Singh, Pablo Zinemanas, Magdalena Fuentes
2022 Zenodo  
More recent deep learning-based methods focus on learning semantic audiovisual representations in a self-supervised manner and using them for localizing sounding objects.  ...  An analysis of the strengths and weaknesses of our methods helps us better understand the problem of visual sound source localization and sheds new light on the characteristics of our dataset.  ...  Chapter 2 starts with a general overview of self-supervised representation learning and then presents a review of the state-of-the-art in visual sound source localization.  ... 
doi:10.5281/zenodo.7116361 fatcat:spidpgfdajdstmqevkkurad4xq

Quantitative assessment of spatial sound distortion by the semi-ideal recording point of a hear-through device

Pablo Hoffmann, Flemming Christensen, Dorte Hammersho/i
2013 Journal of the Acoustical Society of America  
This involves estimating the scattering area at each sounding based on local seafloor slopes.  ...  Our proposal improves localization accuracy for sound sources reproduced by horizontal loudspeaker arrays.  ...  is utilized on the sound localization in the median plane.  ... 
doi:10.1121/1.4805375 fatcat:u4bvxh6karet3avpjdhpfwqpf4

FlowGrad: Using Motion for Visual Sound Source Localization [article]

Rajsuryan Singh, Pablo Zinemanas, Xavier Serra, Juan Pablo Bello, Magdalena Fuentes
2022 arXiv   pre-print
Most recent work in visual sound source localization relies on semantic audio-visual representations learned in a self-supervised manner, and by design excludes temporal information present in videos.  ...  This work introduces temporal context into the state-of-the-art methods for sound source localization in urban scenes using optical flow as a means to encode motion information.  ...  These methods focus on learning semantic auditory and visual representations in a self-supervised manner that enables sound source localization (SSL) via the similarity between audio and visual embeddings  ... 
arXiv:2211.08367v1 fatcat:eq3vshoi25f2bedftqgbnoygxy

Randomised controlled feasibility trial of the Active Communication Education programme plus hearing aid provision versus hearing aid provision alone (ACE to HEAR): a study protocol

Nicholas J Thyer, Jude Watson, Cath Jackson, Louise Hickson, Christina Maynard, Anne Forster, Laura Clark, Kerry Bell, Caroline Fairhurst, Kim Cocks, Rob Gardner, Kate Iley (+1 others)
2018 BMJ Open  
These will be sourced from a combination of local costings and national databases. 64 The costing approach will take a broad analytical perspective accounting for NHS costs and for those observed by  ...  Downloaded from Figure 1 1 ACE to HEAR study flow diagram.  ... 
doi:10.1136/bmjopen-2018-021502 pmid:30068614 pmcid:PMC6074637 fatcat:hobbgn6qfvg2hcjydv76vcs5uq

Experimental investigation of the effect of middle ear in bone conduction

Ivo Dobrev, Tahmine S. Farahmandi, Christof Röösli
2020 Hearing Research  
This was based on sequential measurements of the 3D velocity of the stapes footplate and the promontory.  ...  In parallel, the differential tympanic membrane (TM) pressure was recorded by measuring sound pressure in the middle ear and in the external auditory canal each measured 1-2 mm from the TM.  ...  The orientation of the optical axis (Z axis) of 3D LDV was visually adjusted to be approximately normal to the skull surface.  ... 
doi:10.1016/j.heares.2020.108041 pmid:32810722 fatcat:a3xfc34mpnbxdj4jobwpraam2u

No Evidence That Frontal Optical Flow Affects Perceived Locomotor Speed and Locomotor Biomechanics When Running on a Treadmill

Martina Caramenti, Claudio L. Lafortuna, Elena Mugellini, Omar Abou Khaled, Jean-Pierre Bresciani, Amandine Dubois
2019 Applied Sciences  
In Experiment 2, 20 healthy participants ran at a previously self-selected constant speed while being presented with different optical flow conditions (see Experiment 1).  ...  slower/faster optical flow.  ...  response device, and Thibaut Le Naour (Department of Neuroscience and Movement Science, University of Fribourg, Fribourg, Switzerland) for his help in the creation of the representation of the experimental  ... 
doi:10.3390/app9214589 fatcat:uteipjhhnfetzpwo27gmmf4pme

Self-Supervised Learning of Audio-Visual Objects from Video [article]

Triantafyllos Afouras, Andrew Owens, Joon Son Chung, Andrew Zisserman
2020 arXiv   pre-print
To this end, we introduce a model that uses attention to localize and group sound sources, and optical flow to aggregate information over time.  ...  We demonstrate the effectiveness of the audio-visual object embeddings that our model learns by using them for four downstream speech-oriented tasks: (a) multi-speaker sound source separation, (b) localizing  ...  Kalogeiton for generous help with the annotations and the Friends videos, A. A. Efros for helpful discussions, L. Momeni, T. Han and Q. Pleple for proofreading, A. Dutta for help with VIA, and A.  ... 
arXiv:2008.04237v1 fatcat:6qs4sxx3qfgzdcr77zlw7zzyvi

The Sound of Motions [article]

Hang Zhao, Chuang Gan, Wei-Chiu Ma, Antonio Torralba
2019 arXiv   pre-print
Inspired by the fact that humans is capable of interpreting sound sources from how objects move visually, we propose a novel system that explicitly captures such motion cues for the task of sound localization  ...  Quantitative and qualitative evaluations show that comparing to previous models that rely on visual appearance cues, our motion based system improves performance in separating musical instrument sounds  ...  Given the recent advances on CNN-based optical flow estimation, we incorporate a state-of-the-art optical flow model PWC-Net [44] into our system.  ... 
arXiv:1904.05979v1 fatcat:tbjwa6uoorgrnouke5tjcyryny

The role of extended preoperative steroids in hearing preservation cochlear implantation

Jafri Kuthubutheen, Harvey Coates, Corwyn Rowsell, Julian Nedzelski, Joseph M. Chen, Vincent Lin
2015 Hearing Research  
The second aim is to examine the role of extended preoperative systemic steroids in hearing preservation CI in an animal model.  ...  In addition, the pure tone average (PTA) and hearing preservation rate was calculated. All patients received the same electrode. -v -  ...  Residents and fellows differed in their ability to insert the electrode under supervision.  ... 
doi:10.1016/j.heares.2015.06.010 pmid:26117408 fatcat:jndj6sxkl5b2jikm6x7gfaaf3y
« Previous Showing results 1 — 15 out of 3,724 results