marytts.signalproc.process

Class FramewiseMerger

java.lang.Object

marytts.util.data.BaseDoubleDataSource

marytts.util.data.BufferedDoubleDataSource

marytts.util.data.BlockwiseDoubleDataSource

marytts.signalproc.process.FrameOverlapAddSource

marytts.signalproc.process.FramewiseMerger

All Implemented Interfaces:

DoubleDataSource

public class FramewiseMerger
extends FrameOverlapAddSource

A class to merge two audio signals, using pitch-synchronous frames.

Author:

marc

Field Summary

Fields

Modifier and Type	Field and Description
protected double	currentLabel
protected double	currentOtherLabel
protected DoubleDataSource	labelTimes
protected double	localTimeStretchFactor
protected FrameProvider	otherFrameProvider
protected DoubleDataSource	otherLabelTimes
protected double	prevLabel
protected double	prevOtherLabel

Fields inherited from class marytts.signalproc.process.FrameOverlapAddSource

DEFAULT_WINDOWTYPE, frameProvider, memory, outputWindow, processor

Fields inherited from class marytts.util.data.BlockwiseDoubleDataSource

blockSize

Fields inherited from class marytts.util.data.BufferedDoubleDataSource

buf, dataProcessor, DEFAULT_BUFFERSIZE, readPos, writePos

Fields inherited from class marytts.util.data.BaseDoubleDataSource

dataLength, inputSource

Fields inherited from interface marytts.util.data.DoubleDataSource

NOT_SPECIFIED

Constructor Summary

Constructors

Constructor and Description
FramewiseMerger(DoubleDataSource inputSource, DoubleDataSource pitchmarks, int samplingRate, DoubleDataSource labelTimes, DoubleDataSource otherSource, DoubleDataSource otherPitchmarks, int otherSamplingRate, DoubleDataSource otherLabelTimes, InlineFrameMerger merger) Create a new merger, creating audio by pitch-synchronous merging of audio frames from a source (aka the "signal") and a target (aka the "other"), linearly mapping the corresponding times between the two sources.
FramewiseMerger(DoubleDataSource inputSource, int frameLength, int samplingRate, DoubleDataSource labelTimes, DoubleDataSource otherSource, int otherSamplingRate, DoubleDataSource otherLabelTimes, InlineFrameMerger merger) Create a new merger, creating audio by merging of audio frames at a fixed frame rate, from a source (aka the "signal") and a target (aka the "other"), linearly mapping the corresponding times between the two sources.

Method Summary

Methods

Modifier and Type	Method and Description
protected int	getBlockSize() Output blocksize -- here, this is the same as the input frame shift.
protected double[]	getNextFrame() Get the next frame of input data.
static void	main(String[] args)

Methods inherited from class marytts.signalproc.process.FrameOverlapAddSource

getInputFrameshift, hasMoreData, initialise, prepareBlock, readBlock

Methods inherited from class marytts.util.data.BlockwiseDoubleDataSource

readIntoBuffer

Methods inherited from class marytts.util.data.BufferedDoubleDataSource

available, bufferSpaceLeft, compact, currentlyInBuffer, getData, increaseBufferSize

Methods inherited from class marytts.util.data.BaseDoubleDataSource

getAllData, getData, getData, getDataLength

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

labelTimes

protected DoubleDataSource labelTimes

otherLabelTimes

protected DoubleDataSource otherLabelTimes

otherFrameProvider

protected FrameProvider otherFrameProvider

prevLabel

protected double prevLabel

currentLabel

protected double currentLabel

prevOtherLabel

protected double prevOtherLabel

currentOtherLabel

protected double currentOtherLabel

localTimeStretchFactor

protected double localTimeStretchFactor

Constructor Detail

FramewiseMerger

public FramewiseMerger(DoubleDataSource inputSource,
               DoubleDataSource pitchmarks,
               int samplingRate,
               DoubleDataSource labelTimes,
               DoubleDataSource otherSource,
               DoubleDataSource otherPitchmarks,
               int otherSamplingRate,
               DoubleDataSource otherLabelTimes,
               InlineFrameMerger merger)

Create a new merger, creating audio by pitch-synchronous merging of audio frames from a source (aka the "signal") and a target (aka the "other"), linearly mapping the corresponding times between the two sources.

Parameters:

inputSource - the audio data for the signal

pitchmarks - the pitchmarks for the signal

samplingRate - the sampling rate for the signal

labelTimes - optionally, the label times for the signal, needed for time alignment between the signal and the other

otherSource - the audio data for the other

otherPitchmarks - the pitchmarks for the other

otherSamplingRate - the sampling rate for the other

otherLabelTimes - optionally, the label times for the other; if both are present, the time interval between the i-th and the (i+1)-th label time is linearly stretched/squeezed in order to find the mapping frame for interpolation

merger - the signal processing method used for merging the properties of the "other" into the corresponding frame in the "signal".

FramewiseMerger

public FramewiseMerger(DoubleDataSource inputSource,
               int frameLength,
               int samplingRate,
               DoubleDataSource labelTimes,
               DoubleDataSource otherSource,
               int otherSamplingRate,
               DoubleDataSource otherLabelTimes,
               InlineFrameMerger merger)

Create a new merger, creating audio by merging of audio frames at a fixed frame rate, from a source (aka the "signal") and a target (aka the "other"), linearly mapping the corresponding times between the two sources.

Parameters:

inputSource - the audio data for the signal

frameLength - length of the fixed-length frames

samplingRate - the sampling rate for the signal

labelTimes - optionally, the label times for the signal, needed for time alignment between the signal and the other

otherSource - the audio data for the other

otherSamplingRate - the sampling rate for the other

otherLabelTimes - optionally, the label times for the other; if both are present, the time interval between the i-th and the (i+1)-th label time is linearly stretched/squeezed in order to find the mapping frame for interpolation

merger - the signal processing method used for merging the properties of the "other" into the corresponding frame in the "signal".

Method Detail

getNextFrame

protected double[] getNextFrame()

Get the next frame of input data. This method is called by prepareBlock() when preparing the output data to be read. This implementation reads the data from the frameProvider. In addition, the appropriate "other" frame is identified; this is the frame closest in starting time to the starting time of the next "signal" frame (i.e., the starting time of the return value of this method), correcting for the label times. Concretely, if the start time t_s of the next signal frame is between labelTimes[i] and labelTimes[i+1], then the optimal other frame starting time to would be: t_o = otherLabelTimes[i] + (t_s - labelTimes[i])/(labelTimes[i+1]-labelTimes[i]) * (otherLabelTimes[i+1] - otherLabelTimes[i]) The other frame whose starting time is closest to to will be prepared as for merging.

Overrides:

getNextFrame in class FrameOverlapAddSource

Returns:

the next signal frame.

getBlockSize

protected int getBlockSize()

Output blocksize -- here, this is the same as the input frame shift.

Overrides:

getBlockSize in class FrameOverlapAddSource

Returns:

blocksize

main

public static void main(String[] args)

Parameters:

args - args