Bilinear time–frequency distribution
Bilinear time–frequency distributions, or quadratic time–frequency distributions, arise in a sub-field of signal analysis and signal processing called time–frequency signal processing, and, in the statistical analysis of time series data. Such methods are used where one needs to deal with a situation where the frequency composition of a signal may be changing over time;[1] this sub-field used to be called time–frequency signal analysis, and is now more often called time–frequency signal processing due to the progress in using these methods to a wide range of signal-processing problems.
Background
Methods for analysing time series, in both signal analysis and time series analysis, have been developed as essentially separate methodologies applicable to, and based in, either the time or the frequency domain. A mixed approach is required in time–frequency analysis techniques which are especially effective in analyzing non-stationary signals, whose frequency distribution and magnitude vary with time. Examples of these are acoustic signals. Classes of "quadratic time-frequency distributions" (or bilinear time–frequency distributions") are used for time–frequency signal analysis. This class is similar in formulation to Cohen's class distribution function that was used in 1966 in the context of quantum mechanics. This distribution function is mathematically similar to a generalized time–frequency representation which utilizes bilinear transformations. Compared with other time–frequency analysis techniques, such as short-time Fourier transform (STFT), the bilinear-transformation (or quadratic time–frequency distributions) may not have higher clarity for most practical signals, but it provides an alternative framework to investigate new definitions and new methods. While it does suffer from an inherent cross-term contamination when analyzing multi-component signals, by using a carefully chosen window function(s), the interference can be significantly mitigated, at the expense of resolution. All these bilinear distributions are inter-convertible to each other, cf. transformation between distributions in time–frequency analysis.
Wigner–Ville distribution
The Wigner–Ville distribution is a quadratic form that measures a local time-frequency energy given by:
The Wigner–Ville distribution remains real as it is the fourier transform of f(u + τ/2)·f*(u − τ/2), which has Hermitian symmetry in τ. It can also be written as a frequency integration by applying the Parseval formula:
- Proposition 1. for any f in L^{2}(R)
- Moyal Theorem. For f and g in L^{2}(R),
- Proposition 2 (time-frequency support). If f has a compact support, then for all ξ the support of along u is equal to the support of f. Similarly, if has a compact support, then for all u the support of along ξ is equal to the support of .
- Proposition 3 (instantaneous frequency). If then
Interference
Let be a composite signal. We can then write,
where
is the cross Wigner–Ville distribution of two signals. The interference term
is a real function that creates non-zero values at unexpected locations(close to the origin) in the plane. Interference terms present in a real signal can be avoided by computing the analytic part .
Positivity and smoothing kernel
The interference terms are oscillatory since the marginal integrals vanish and can be partially removed by smoothing with a kernel θ
The time-frequency resolution of this distribution depends on the spread of kernel θ in the neighborhood of . Since the interferences take negative values, one can guarantee that all interferences are removed by imposing that
The spectrogram and scalogram are examples of positive time-frequency energy distributions. Let a linear transform be defined over a family of time-frequency atoms . For any there exists a unique atom centered in time-frequency at . The resulting time-frequency energy density is
From the Moyal formula,
which is the time frequency averaging of a Wigner–Ville distribution. The smoothing kernel thus can be written as
The loss of time-frequency resolution depends on the spread of the distribution in the neighborhood of .
Example 1
A spectrogram computed with windowed fourier atoms,
For a spectrogram, the Wigner–Ville averaging is therefore a 2-dimensional convolution with . If g is a Gaussian window, is a 2-dimensional Gaussian. This proves that averaging with a sufficiently wide Gaussian defines positive energy density. The general class of time-frequency distributions obtained by convolving with an arbitrary kernel θ is called a Cohen's class, discussed below.
Wigner Theorem. There is no positive quadratic energy distribution Pf that satisfies the following time and frequency marginal integrals:
Mathematical definition
The definition of Cohen's class of bilinear (or quadratic) time–frequency distributions is as follows:
where is the ambiguity function (AF), which will be discussed later; and is Cohen's kernel function, which is often a low-pass function, and normally serves to mask out the interference. In the original Wigner representation, .
An equivalent definition relies on a convolution of the Wigner distribution function (WD) instead of the AF :
where the kernel function is defined in the time-frequency domain instead of the ambiguity one. In the original Wigner representation, . The relationship between the two kernels is the same as the one between the WD and the AF, namely two successive Fourier transforms (cf. diagram).
i.e.
or equivalently
Ambiguity function
The class of bilinear (or quadratic) time–frequency distributions can be most easily understood in terms of the ambiguity function, an explanation of which follows.
Consider the well known power spectral density and the signal auto-correlation function in the case of a stationary process. The relationship between these functions is as follows:
For a non-stationary signal , these relations can be generalized using a time-dependent power spectral density or equivalently the famous Wigner distribution function of as follows:
If the Fourier transform of the auto-correlation function is taken with respect to t instead of τ, we get the ambiguity function as follows:
The relationship between the Wigner distribution function, the auto-correlation function and the ambiguity function can then be illustrated by the following figure.
By comparing the definition of bilinear (or quadratic) time–frequency distributions with that of the Wigner distribution function, it is easily found that the latter is a special case of the former with . Alternatively, bilinear (or quadratic) time–frequency distributions can be regarded as a masked version of the Wigner distribution function if a kernel function is chosen. A properly chosen kernel function can significantly reduce the undesirable cross-term of the Wigner distribution function.
What is the benefit of the additional kernel function? The following figure shows the distribution of the auto-term and the cross-term of a multi-component signal in both the ambiguity and the Wigner distribution function.
For multi-component signals in general, the distribution of its auto-term and cross-term within its Wigner distribution function is generally not predictable, and hence the cross-term cannot be removed easily. However, as shown in the figure, for the ambiguity function, the auto-term of the multi-component signal will inherently tend to close the origin in the ητ-plane, and the cross-term will tend to be away from the origin. With this property, the cross-term in can be filtered out effortlessly if a proper low-pass kernel function is applied in ητ-domain. The following is an example that demonstrates how the cross-term is filtered out.
Kernel properties
The Fourier transform of is
The following proposition gives necessary and sufficient conditions to ensure that satisfies marginal energy properties like those of the Wigner–Ville distribution.
- Proposition: The marginal energy properties
- are satisfied for all if and only if
Some time-frequency distributions
Wigner distribution function
Aforementioned, the Wigner distribution function is a member of the class of quadratic time-frequency distributions (QTFDs) with the kernel function . The definition of Wigner distribution is as follows:
Modified Wigner distribution functions
Affine invariance
We can design time-frequency energy distributions that satisfy the scaling property
as does the Wigner–Ville distribution. If
then
This is equivalent to imposing that
and hence
The Rihaczek and Choi–Williams distributions are examples of affine invariant Cohen's class distributions.
Choi–Williams distribution function
The kernel of Choi–Williams distribution is defined as follows:
where α is an adjustable parameter.
Rihaczek distribution function
The kernel of Rihaczek distribution is defined as follows:
With this particular kernel a simple calculation proves that
Cone-shape distribution function
The kernel of cone-shape distribution function is defined as follows:
where α is an adjustable parameter. See Transformation between distributions in time-frequency analysis. More such QTFDs and a full list can be found in, e.g., Cohen's text cited.
Spectrum of non-stationary processes
A time-varying spectrum for non-stationary processes is defined from the expected Wigner–Ville distribution. Locally stationary processes appear in many physical systems where random fluctuations are produced by a mechanism that changes slowly in time. Such processes can be approximated locally by a stationary process. Let be a real valued zero-mean process with covariance
The covariance operator K is defined for any deterministic signal by
For locally stationary processes, the eigenvectors of K are well approximated by the Wigner–Ville spectrum.
Wigner–Ville spectrum
The properties of the covariance are studied as a function of and :
The process is wide-sense stationary if the covariance depends only on :
The eigenvectors are the complex exponentials and the corresponding eigenvalues are given by the power spectrum
For non-stationary processes, Martin and Flandrin have introduced a time-varying spectrum
To avoid convergence issues we suppose that X has compact support so that has compact support in . From above we can write
which proves that the time varying spectrum is the expected value of the Wigner–Ville transform of the process X. Here, the Wigner–Ville stochastic integral is interpreted as a mean-square integral:[2]
References
- E. Sejdić, I. Djurović, J. Jiang, “Time-frequency feature representation using energy concentration: An overview of recent advances,” Digital Signal Processing, vol. 19, no. 1, pp. 153–183, January 2009.
- a wavelet tour of signal processing, Stephane Mallat
- L. Cohen, Time-Frequency Analysis, Prentice-Hall, New York, 1995. ISBN 978-0135945322
- B. Boashash, editor, “Time-Frequency Signal Analysis and Processing – A Comprehensive Reference”, Elsevier Science, Oxford, 2003.
- L. Cohen, “Time-Frequency Distributions—A Review,” Proceedings of the IEEE, vol. 77, no. 7, pp. 941–981, 1989.
- S. Qian and D. Chen, Joint Time-Frequency Analysis: Methods and Applications, Chap. 5, Prentice Hall, N.J., 1996.
- H. Choi and W. J. Williams, “Improved time-frequency representation of multicomponent signals using exponential kernels,” IEEE. Trans. Acoustics, Speech, Signal Processing, vol. 37, no. 6, pp. 862–871, June 1989.
- Y. Zhao, L. E. Atlas, and R. J. Marks, “The use of cone-shape kernels for generalized time-frequency representations of nonstationary signals,” IEEE Trans. Acoustics, Speech, Signal Processing, vol. 38, no. 7, pp. 1084–1091, July 1990.
- B. Boashash, “Heuristic Formulation of Time-Frequency Distributions”, Chapter 2, pp. 29–58, in B. Boashash, editor, Time-Frequency Signal Analysis and Processing: A Comprehensive Reference, Elsevier Science, Oxford, 2003.
- B. Boashash, “Theory of Quadratic TFDs”, Chapter 3, pp. 59–82, in B. Boashash, editor, Time-Frequency Signal Analysis & Processing: A Comprehensive Reference, Elsevier, Oxford, 2003.