Fujisaki model

An F0 contour is obtained by adding the phrase and accent components to the base frequency

The Fujisaki model is a superpositional model for representing F₀ contour of speech.

As a model of intonation, it was a major milestone in prosody modeling for speech synthesis.

According to the model, F₀ contour is generated as a result of the superposition of the outputs of two second order linear filters with a base frequency value. The second order linear filters are for generating the phrase and accent components of speech. The base frequency is the minimum frequency value of the speaker. In other words, F₀ contour is obtained by adding base frequency, phrase components and accent components. The model was proposed by Hiroya Fujisaki.

$\ln(F_{0}(t))=\ln(F_{b})+\sum _{i=1}^{I}A_{pi}G_{pi}(t-T_{0i})+\sum _{j=1}^{J}A_{aj}\{G_{aj}(t-T_{1j})-G_{aj}(t-T_{2j})\}$
where
$G_{pi}(t)=\alpha _{i}^{2}t\,\exp(-\alpha _{i}t)\quad \forall t\geq 0;=0\forall t\leq 0$
${\textstyle G_{aj}(t)=\min[\gamma _{j},\,1-(1+\beta _{j}t)\,\exp(-\beta _{j}t)]\quad \forall t\geq 0;=0\forall t\leq 0}$

Where,

$F_{b}$: bias level upon which all the phrase and accent components are superposed to form an $F_{0}$ contour,

$I$ : number of phrase commands,

$J$ : number of accent commands,

$A_{pi}$ : magnitude of the ith phrase command,

$A_{aj}$ : amplitude of the jth accent command,

$T_{0i}$ : instant of occurrence of the ith phrase command,

$T_{1j}$ : onset of the jth accent command,

$T_{2j}$ : end of the jth accent command,

$\alpha _{i}$ : natural angular frequency of the phrase control mechanism to the ith phrase command,

$\beta _{j}$ : natural angular frequency of the accent control mechanism to the jth accent command, and

$\gamma _{j}$ : ceiling level of the accent component for the jth accent command.

Bibliography

• Dutoit, Thierry (2001). An Introduction to Text-to-Speech Synthesis. Kluwer Academic Publishers. ISBN 1-4020-0369-2.
• Hirose, Keikichi; Fujisaki, Hiroya; Yamaguchi, Mikio (1984). "Synthesis by rule of voice fundamental frequency contours of spoken Japanese from linguistic information". ICASSP '84. IEEE International Conference on Acoustics, Speech, and Signal Processing. 9: 597–600. Bibcode:1984assp....9..459H. doi:10.1109/ICASSP.1984.1172814.