请输入您要查询的百科知识:

 

词条 Spectrogram
释义

  1. Format

  2. Generation

  3. Limitations and resynthesis

  4. Applications

  5. See also

  6. References

  7. External links

{{short description|Visual representation of the spectrum of frequencies of a signal as it varies with time}}{{redirect|Sonograph|the EP by Early Day Miners|Sonograph (EP)|the scientific instrument|Spectrograph}}

A spectrogram is a visual representation of the spectrum of frequencies of a signal as it varies with time.

When applied to an audio signal, spectrograms are sometimes called sonographs, voiceprints, or voicegrams.

When the data is represented in a 3D plot they may be called waterfalls.

Spectrograms are used extensively in the fields of music, sonar, radar, and speech processing,[1] seismology, and others. Spectrograms of audio can be used to identify spoken words phonetically, and to analyse the various calls of animals.

A spectrogram can be generated by an optical spectrometer, a bank of band-pass filters, by Fourier transform or by a wavelet transform (in which case it is also known as a scaleogram).[2]

A spectrogram is usually depicted as a heat map, i.e., as an image with the intensity shown by varying the colour or brightness.

Format

A common format is a graph with two geometric dimensions: one axis represents time or RPM,[3]{{failed verification|reason=No mention of "Spectrogram" in source.|date=November 2017}} the other axis is frequency; a third dimension indicating the amplitude of a particular frequency at a particular time is represented by the intensity or color of each point in the image.

There are many variations of format: sometimes the vertical and horizontal axes are switched, so time runs up and down; sometimes as a waterfall plot where the amplitude is represented by height of a 3D surface instead of color or intensity. The frequency and amplitude axes can be either linear or logarithmic, depending on what the graph is being used for. Audio would usually be represented with a logarithmic amplitude axis (probably in decibels, or dB), and frequency would be linear to emphasize harmonic relationships, or logarithmic to emphasize musical, tonal relationships.

{{Gallery
|File:Spectrogram of violin.png|Spectrogram of this recording of a violin playing. Note the harmonics occurring at whole-number multiples of the fundamental frequency.
|File:Spectrogram.png|3D surface spectrogram of a part from a music piece.
|File:Praat-spectrogram-tatata.png|Spectrogram of a male voice saying 'ta ta ta'.
|File:Dolphin1.jpg|alt6=|Spectrogram of dolphin vocalizations; chirps, clicks and harmonizing are visible as inverted Vs, vertical lines and horizontal striations respectively.
}}{{Gallery
|File:VariableFrequency.jpg|Spectrogram of an FM signal. In this case the signal frequency is modulated with a sinusoidal frequency vs. time profile.
|File:PAL-I.png|Spectrum above and waterfall (Spectrogram) below of an 8MHz wide PAL-I Television signal.
|File:Parus major sonagram.jpg|Spectrogram of great tit song.
|File:GW170817 Gravitational Wave Chirp Spectrogram.jpg|alt8=|Spectrogram of a gravitational wave (GW170817).
|File:Waterfall_plot_of_a_whistle.png|alt9=|Spectrogram and waterfalls of 3 whistled notes.
}}

Generation

Spectrograms of light may be created directly using an optical spectrometer over time.

Spectrograms may be created from a time-domain signal in one of two ways: approximated as a filterbank that results from a series of band-pass filters (this was the only way before the advent of modern digital signal processing), or calculated from the time signal using the Fourier transform. These two methods actually form two different time–frequency representations, but are equivalent under some conditions.

The bandpass filters method usually uses analog processing to divide the input signal into frequency bands; the magnitude of each filter's output controls a transducer that records the spectrogram as an image on paper.[4]

Creating a spectrogram using the FFT is a digital process. Digitally sampled data, in the time domain, is broken up into chunks, which usually overlap, and Fourier transformed to calculate the magnitude of the frequency spectrum for each chunk. Each chunk then corresponds to a vertical line in the image; a measurement of magnitude versus frequency for a specific moment in time (the midpoint of the chunk). These spectrums or time plots are then "laid side by side" to form the image or a three-dimensional surface,[5] or slightly overlapped in various ways, i.e. windowing. This process essentially corresponds to computing the squared magnitude of the short-time Fourier transform (STFT) of the signal — that is, for a window width , .[6]

Limitations and resynthesis

From the formula above, it appears that a spectrogram contains no information about the exact, or even approximate, phase of the signal that it represents. For this reason, it is not possible to reverse the process and generate a copy of the original signal from a spectrogram, though in situations where the exact initial phase is unimportant it may be possible to generate a useful approximation of the original signal. The Analysis & Resynthesis Sound Spectrograph[7] is an example of a computer program that attempts to do this. The Pattern Playback was an early speech synthesizer, designed at Haskins Laboratories in the late 1940s, that converted pictures of the acoustic patterns of speech (spectrograms) back into sound.

In fact, there is some phase information in the spectrogram, but it appears in another form, as time delay (or group delay) which is the dual of the Instantaneous Frequency {{citation needed|date=November 2014}}.

The size and shape of the analysis window can be varied. A smaller (shorter) window will produce more accurate results in timing, at the expense of precision of frequency representation. A larger (longer) window will provide a more precise frequency representation, at the expense of precision in timing representation. This is an instance of the Heisenberg uncertainty principle, that the product of the precision in two conjugate variables is less than or equal to a constant (B*T>=1 in the usual notation).[8]

Applications

  • Early analog spectrograms were applied to a wide range of areas including the study of bird calls (such as that of the great tit), with current research continuing using modern digital equipment[9] and applied to all animal sounds. Contemporary use of the digital spectrogram is especially useful for studying frequency modulation (FM) in animal calls. Specifically, the distinguishing characteristics of FM chirps, broadband clicks, and social harmonizing are most easily visualized with the spectrogram.
  • Spectrograms are useful in assisting in overcoming speech deficits and in speech training for the portion of the population that is profoundly deaf[10]
  • The studies of phonetics and speech synthesis are often facilitated through the use of spectrograms.[11][12]
  • By reversing the process of producing a spectrogram, it is possible to create a signal whose spectrogram is an arbitrary image. This technique can be used to hide a picture in a piece of audio and has been employed by several electronic music artists.[13] See also steganography.
  • Some modern music is created using spectrograms as an intermediate medium; changing the intensity of different frequencies over time, or even creating new ones, by drawing them and then inverse transforming. See Audio timescale-pitch modification and Phase vocoder.
  • Spectrograms can be used to analyze the results of passing a test signal through a signal processor such as a filter in order to check its performance.[14]
  • High definition spectrograms are used in the development of RF and microwave systems[15]
  • Spectrograms are now used to display scattering parameters measured with vector network analyzers[16]
  • The US Geological Survey now provides real-time spectrogram displays from seismic stations[17]
  • Spectrograms can be used with recurrent neural networks for speech recognition.[18]
{{clear}}

See also

{{div col|colwidth=20em}}
  • Acoustic signature
  • Chromagram
  • Generalized spectrogram
  • List of unexplained sounds
  • Reassignment method
  • Scaleogram
  • Short-time Fourier transform
  • Spectral music
  • Spectrometer
  • Spectrum
  • Strobe tuner
  • Time-frequency representation
  • Waterfall plot
  • Wavelet transform
{{div col end}}

References

1. ^JL Flanagan, Speech Analysis, Synthesis and Perception, Springer- Verlag, New York, 1972
2. ^{{Cite journal|last=Sejdic|first=E.|last2=Djurovic|first2=I.|last3=Stankovic|first3=L.|date=August 2008|title=Quantitative Performance Analysis of Scalogram as Instantaneous Frequency Estimator|url=http://ieeexplore.ieee.org/document/4511413/|journal=IEEE Transactions on Signal Processing|volume=56|issue=8|pages=3837–3845|doi=10.1109/TSP.2008.924856|issn=1053-587X}}
3. ^{{cite web|url=https://community.plm.automation.siemens.com/t5/Testing-Knowledge-Base/What-s-an-Order/ta-p/355020|title=What's an Order?|author=|date=11 July 2016|website=siemens.com|accessdate=7 April 2018}}
4. ^{{cite web|url=https://www.sfu.ca/sonic-studio/handbook/Spectrograph.html|title=Spectrograph|author=|date=|website=www.sfu.ca|accessdate=7 April 2018}}
5. ^{{cite web|url=https://ccrma.stanford.edu/~jos/mdft/Spectrograms.html|title=Spectrograms|author=|date=|website=ccrma.stanford.edu|accessdate=7 April 2018}}
6. ^{{cite web|url=http://zone.ni.com/reference/en-XX/help/371361E-01/lvanls/stft_spectrogram_core/#details|title=STFT Spectrograms VI - NI LabVIEW 8.6 Help|author=|date=|website=zone.ni.com|accessdate=7 April 2018}}
7. ^{{cite web|url=http://arss.sourceforge.net|title=The Analysis & Resynthesis Sound Spectrograph|author=|date=|website=arss.sourceforge.net|accessdate=7 April 2018}}
8. ^http://fourier.eng.hmc.edu/e161/lectures/fourier/node2.html
9. ^{{cite web|url=http://www.birdsongs.it/index.asp|title=BIRD SONGS AND CALLS WITH SPECTROGRAMS ( SONOGRAMS ) OF SOUTHERN TUSCANY ( Toscana - Italy )|author=|date=|website=www.birdsongs.it|accessdate=7 April 2018}}
10. ^{{cite journal|title=A wearable tactile sensory aid for profoundly deaf children|first1=Frank A.|last1=Saunders|first2=William A.|last2=Hill|first3=Barbara|last3=Franklin|date=1 December 1981|journal=Journal of Medical Systems|volume=5|issue=4|pages=265–270|doi=10.1007/BF02222144}}
11. ^{{cite web|url=http://cslu.cse.ogi.edu/tutordemos/SpectrogramReading/spectrogram_reading.html|title=Spectrogram Reading|author=|date=|website=ogi.edu|accessdate=7 April 2018|deadurl=yes|archiveurl=https://web.archive.org/web/19990427185722/http://cslu.cse.ogi.edu/tutordemos/SpectrogramReading/spectrogram_reading.html |archivedate=27 April 1999|df=}}
12. ^{{cite web|url=http://www.fon.hum.uva.nl/praat/|title=Praat: doing Phonetics by Computer|author=|date=|website=www.fon.hum.uva.nl|accessdate=7 April 2018}}
13. ^{{cite web|url=http://www.bastwood.com/aphex.php|title=The Aphex Face - bastwood|author=|date=|website=www.bastwood.com|accessdate=7 April 2018}}
14. ^{{cite web|url=http://src.infinitewave.ca|title=SRC Comparisons|author=|date=|website=src.infinitewave.ca|accessdate=7 April 2018}}
15. ^{{cite web|url=http://www.constantwave.com/gallery.aspx|title=constantwave.com - constantwave Resources and Information.|author=|date=|website=www.constantwave.com|accessdate=7 April 2018}}
16. ^{{cite web |url=http://www.constantwave.com/spectro_vna.aspx |title=Spectrograms for vector network analyzers |archive-url=https://web.archive.org/web/20120810020043/http://www.constantwave.com/spectro_vna.aspx |archive-date=2012-08-10 |deadurl=yes |df= }}
17. ^{{cite web|url=https://earthquake.usgs.gov/monitoring/spectrograms/24hr/|title=Real-time Spectrogram Displays|author=|date=|website=earthquake.usgs.gov|accessdate=7 April 2018}}
18. ^{{Cite web|url=https://medium.com/@ageitgey/machine-learning-is-fun-part-6-how-to-do-speech-recognition-with-deep-learning-28293c162f7a|title=Machine Learning is Fun Part 6: How to do Speech Recognition with Deep Learning|last=Geitgey|first=Adam|date=2016-12-24|website=Medium|access-date=2018-03-21}}

External links

{{Commons category|Spectrogram}}{{Wiktionary}}
  • [https://auditoryneuroscience.com/acoustics/spectrogram See an online spectrogram of speech or other sounds captured by your computer's microphone.]
  • Generating a tone sequence whose spectrogram matches an arbitrary text, online
  • [https://web.archive.org/web/20110725231858/http://devrand.org/show_item.html?item=64&page=Project Further information on creating a signal whose spectrogram is an arbitrary image]
  • Article describing the development of a software spectrogram
  • History of spectrograms & development of instrumentation
  • How to identify the words in a spectrogram from a linguistic professor's Monthly Mystery Spectrogram publication.

3 : Acoustic measurement|Signal processing|Time–frequency analysis

随便看

 

开放百科全书收录14589846条英语、德语、日语等多语种百科知识,基本涵盖了大多数领域的百科知识,是一部内容自由、开放的电子版国际百科全书。

 

Copyright © 2023 OENC.NET All Rights Reserved
京ICP备2021023879号 更新时间:2024/11/12 4:34:09