New technology developed by Princeton University computer scientists may do for audio recordings of the human voice what word processing software did for the written word. The software, named VoCo, provides an easy means to add or replace a word in an audio recording of a human voice by editing a transcript of the recording. New words are automatically synthesized in the speaker's voice even if they don't appear anywhere else in the recording. The system, which uses a sophisticated algorithm to learn and recreate the sound of a particular voice, could one day make editing podcasts and narration in videos much easier. More broadly, the technology could provide a launching point for creating personalized robotic voices that sound natural. "VoCo provides a peek at a very practical technology for editing audio tracks, but it is also a harbinger for future technologies that will allow the human voice to be synthesized and automated in remarkable ways," said Adam Finkelstein, a professor of computer science at Princeton who is a member of the development team .
Princeton University news release: https://www.cs.princeton.edu/news/technology-edits-voices-text
Researchers page: http://gfx.cs.princeton.edu/pubs/Jin_2017_VTI/
Additional ArsTechnica article with more video: https://arstechnica.com/information-technology/2016/11/adobe-voco-photoshop-for-audio-speech-editing/