marytts.signalproc.adaptation.codebook

Class WeightedCodebookParallelTransformer

java.lang.Object

marytts.signalproc.adaptation.BaselineTransformer

marytts.signalproc.adaptation.codebook.WeightedCodebookTransformer

marytts.signalproc.adaptation.codebook.WeightedCodebookParallelTransformer

public class WeightedCodebookParallelTransformer
extends WeightedCodebookTransformer

This class implements transformation for weighted codebook mapping based voice conversion using parallel training data (i.e. source and target data in pairs of audio recordings which have identical content) Reference for weighted codebook mapping: Arslan, L. M., 1999, “Speaker Transformation Algorithm using Segmental Codebooks”, Speech Communication, 28, pp. 211-226. Reference for weighted frame mapping: Türk, O., 2007 “Cross-Lingual Voice Conversion”, PhD Thesis, Bogazici University.

Author:

Oytun Türk

Field Summary

Fields

Modifier and Type	Field and Description
WeightedCodebook	codebook
WeightedCodebookMapper	mapper
WeightedCodebookTransformerParams	pa
PitchMapping	pitchMapping

Fields inherited from class marytts.signalproc.adaptation.codebook.WeightedCodebookTransformer

params

Fields inherited from class marytts.signalproc.adaptation.BaselineTransformer

featureExtractor, postprocessor, preprocessor

Constructor Summary

Constructors

Constructor and Description
WeightedCodebookParallelTransformer(BaselinePreprocessor pp, BaselineFeatureExtractor fe, BaselinePostprocessor po, WeightedCodebookTransformerParams pa)

Method Summary

Methods

Modifier and Type	Method and Description
boolean	checkParams()
static void	main(String[] args)
static void	mainNeutralSad()
static void	mainParametric(String inputFolder, String outputBaseFolder, String baseFile, String outputFolderInfoString, boolean isSourceVocalTractSpectrumFromModel, int numBestMatches, boolean isTemporalSmoothing, int smoothingNumNeighbours, boolean isContextBasedPreselection, int totalContextNeighbours, boolean isPitchFromTargetFile, int pitchFromTargetMethod, boolean isDurationFromTargetFile, int durationFromTargetMethod, boolean isEnergyFromTargetFile, boolean isLsfsFromTargetFile, int targetAlignmentFileType)
static void	mainQuickTest2() This example uses the ouput of the example: marytts.signalproc.adaptation.codebook.WeightedCodebookParallelTrainer.mainQuickTest2() Input: /Neutral-Spike-Conversion/codebook/neutral2angry/neutralF_X_angryF_99.pmf /Neutral-Spike-Conversion/codebook/neutral/train_99/*.wav Ouput: /Neutral-Spike-Conversion/codebook/neutral2angry/neutral2angryOut_codebookF3/ isSrc1_nBest15_smooth1_1_context1_5_psUtt1_tsUtt1_prosody1x0x0/*.wav
void	transform(BaselineAdaptationSet inputSet, BaselineAdaptationSet outputSet)
static void	transformOneItem(BaselineAdaptationItem inputItem, BaselineAdaptationItem outputItem, WeightedCodebookTransformerParams wctParams, WeightedCodebookMapper wcMapper, WeightedCodebook wCodebook, PitchTransformationData pMap)

Methods inherited from class marytts.signalproc.adaptation.codebook.WeightedCodebookTransformer

getInputSet, getOutputSet, run

Methods inherited from class marytts.signalproc.adaptation.BaselineTransformer

isScalingsRequired, transformOneItem

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

pa

public WeightedCodebookTransformerParams pa

mapper

public WeightedCodebookMapper mapper

codebook

public WeightedCodebook codebook

pitchMapping

public PitchMapping pitchMapping

Constructor Detail

WeightedCodebookParallelTransformer

public WeightedCodebookParallelTransformer(BaselinePreprocessor pp,
                                   BaselineFeatureExtractor fe,
                                   BaselinePostprocessor po,
                                   WeightedCodebookTransformerParams pa)

Method Detail

checkParams

public boolean checkParams()
                    throws IOException

Overrides:

checkParams in class WeightedCodebookTransformer

Throws:

IOException

transform

public void transform(BaselineAdaptationSet inputSet,
             BaselineAdaptationSet outputSet)
               throws UnsupportedAudioFileException

Overrides:

transform in class BaselineTransformer

Throws:

UnsupportedAudioFileException

transformOneItem

public static void transformOneItem(BaselineAdaptationItem inputItem,
                    BaselineAdaptationItem outputItem,
                    WeightedCodebookTransformerParams wctParams,
                    WeightedCodebookMapper wcMapper,
                    WeightedCodebook wCodebook,
                    PitchTransformationData pMap)
                             throws UnsupportedAudioFileException,
                                    IOException

Throws:

UnsupportedAudioFileException

IOException

main

public static void main(String[] args)
                 throws IOException,
                        UnsupportedAudioFileException

Throws:

IOException

UnsupportedAudioFileException

mainNeutralSad

public static void mainNeutralSad()
                           throws IOException,
                                  UnsupportedAudioFileException

Throws:

IOException

UnsupportedAudioFileException

mainQuickTest2

public static void mainQuickTest2()
                           throws IOException,
                                  UnsupportedAudioFileException

This example uses the ouput of the example: marytts.signalproc.adaptation.codebook.WeightedCodebookParallelTrainer.mainQuickTest2() Input: /Neutral-Spike-Conversion/codebook/neutral2angry/neutralF_X_angryF_99.pmf /Neutral-Spike-Conversion/codebook/neutral/train_99/*.wav Ouput: /Neutral-Spike-Conversion/codebook/neutral2angry/neutral2angryOut_codebookF3/ isSrc1_nBest15_smooth1_1_context1_5_psUtt1_tsUtt1_prosody1x0x0/*.wav

Throws:

IOException - IO exception

UnsupportedAudioFileException - unsupported audio file exception

mainParametric

public static void mainParametric(String inputFolder,
                  String outputBaseFolder,
                  String baseFile,
                  String outputFolderInfoString,
                  boolean isSourceVocalTractSpectrumFromModel,
                  int numBestMatches,
                  boolean isTemporalSmoothing,
                  int smoothingNumNeighbours,
                  boolean isContextBasedPreselection,
                  int totalContextNeighbours,
                  boolean isPitchFromTargetFile,
                  int pitchFromTargetMethod,
                  boolean isDurationFromTargetFile,
                  int durationFromTargetMethod,
                  boolean isEnergyFromTargetFile,
                  boolean isLsfsFromTargetFile,
                  int targetAlignmentFileType)
                           throws IOException,
                                  UnsupportedAudioFileException

Throws:

IOException

UnsupportedAudioFileException