Previous Thread
Index
Next Thread
Print Thread
Go To
Off-Topic
Joined: Sep 2010
Posts: 6,642
dcuny Offline OP
Veteran
OP Offline
Veteran
Joined: Sep 2010
Posts: 6,642
Time for another demo of synSinger:

Twinkle, Twinkle Little Star - synSinger #6


For comparison, here's what it sounded like a couple weeks ago:

Twinkle, Twinkle Little Star - synSinger #5


It's still miles away from SoftVoice, but it is improving incrementally.

If anyone is interested in trying synSinger out, contact me and I'll get you a copy to play with.

I've been in contact with the SoftVoice folk, and apparently a change a couple months ago had unexpected consequences on the singing functionality. So they'll be fixing that, but it'll take a while to fix. The good news for me is that they'll be sending me the demo program after that, so I can create some examples myself to post.

Last edited by dcuny; 05/01/14 08:41 AM. Reason: Forgot to finish a thought.

-- David Cuny
My virtual singer development blog

Vocal control, you say. Never heard of it. Is that some kind of ProTools thing?
Off-Topic
Joined: Jun 2012
Posts: 18,355
Veteran
Offline
Veteran
Joined: Jun 2012
Posts: 18,355
Originally Posted By: dcuny


I've been in contact with the SoftVoice folk, and apparently


Hi David
Don't leave us in suspense like that ...and apparently what? !!


BIAB & RB2024 Win.(Audiophile), Sonar Platinum, Cakewalk by Bandlab, Izotope Prod.Bundle, Roland RD-1000, Synthogy Ivory, Kontakt, Focusrite 18i20, KetronSD2, NS40M Monitors, Pioneer Active Monitors, AKG K271 Studio H'phones
Off-Topic
Joined: Aug 2009
Posts: 2,846
Veteran
Offline
Veteran
Joined: Aug 2009
Posts: 2,846
I'm looking forward to the day when we can load a voice bank of our favourite singers into a program and it will sound exactly like her/him.

Maybe even Elvis will live again.

To be honest I thought we would have reached that stage now such as the advances in technology, but it seems not.

Musiclover


Musiclover

My music https://www.youtube.com/user/donegalprideofall

Windows 10 (64bit) M-Audio Fast Track Pro, Band in a Box 2024, Cubase 13, Cakewalk and far too many VST plugins that I probably don't need or will ever use smile
Off-Topic
Joined: Jun 2012
Posts: 18,355
Veteran
Offline
Veteran
Joined: Jun 2012
Posts: 18,355
I tend to agree Musiclover.

Some software applications for spoken word are quite impressive, incredibly realistic, with nuances, punctuation and expression.
Ivona is one that comes to mind.

But putting musical pitch to that and maintaining realism seems to be at least an order of magnitude more difficult.


BIAB & RB2024 Win.(Audiophile), Sonar Platinum, Cakewalk by Bandlab, Izotope Prod.Bundle, Roland RD-1000, Synthogy Ivory, Kontakt, Focusrite 18i20, KetronSD2, NS40M Monitors, Pioneer Active Monitors, AKG K271 Studio H'phones
Off-Topic
Joined: Sep 2010
Posts: 6,642
dcuny Offline OP
Veteran
OP Offline
Veteran
Joined: Sep 2010
Posts: 6,642
Ooops, sorry about that.

Fixed the first post.

synSinger is taking all my free time (and then some), but I may look into creating a MusicXML to Vocaloid export at some point. There are a couple of problems, though. I don't have an English to SAMPA dictionary (the phonetic coding scheme that Vocaloid uses), and there's no official file spec that I know of (but I know it's a modified form of MIDI).

But for now, getting synSinger to an acceptable level is more than keeping my hands full. frown

I should note that Sinsy uses the same sort of technology that IVONA (and just about all modern TTS software) is based on - Hidden Markov Models. But yes, it takes an entirely different sort of approach to train HMM to deal with music.

So it literally is orders of magnitude harder, because now the training set has to be expanded to include examples of speech for each pitch and duration... unless you're doing a clever hack (like Sinsy) to combine them.

Last edited by dcuny; 05/01/14 08:56 AM.

-- David Cuny
My virtual singer development blog

Vocal control, you say. Never heard of it. Is that some kind of ProTools thing?
Off-Topic
Joined: Aug 2011
Posts: 10,126
Veteran
Offline
Veteran
Joined: Aug 2011
Posts: 10,126
David, I can't even imagine how anyone would want to tackle such a difficult challenge for fun. I admire and respect your gumption.

It's come a long way since the beginning. Getting closer to my wanting to snap my fingers in time with the singer. cool


Jim Fogle - 2024 BiaB (1111) RB (5) Ultra+ PAK
DAWs: Cakewalk by BandLab (CbB) - Standalone: Zoom MRS-8
Laptop: i3 Win 10, 8GB ram 500GB HDD
Desktop: i7 Win 11, 12GB ram 256GB SSD, 4 TB HDD
Music at: https://fogle622.wix.com/fogle622-audio-home
Off-Topic
Joined: Sep 2010
Posts: 6,642
dcuny Offline OP
Veteran
OP Offline
Veteran
Joined: Sep 2010
Posts: 6,642
Originally Posted By: musiclover
I'm looking forward to the day when we can load a voice bank of our favourite singers into a program and it will sound exactly like her/him.


At one point, physical modeling was the way things were done. So the idea was that you could build a simulation of a singer, and then when you ran the simulation you'd end up with something that sounded like that singer.

It's sort of like the idea that you could just capture the notes that various instruments make, and reconstruct music from it. But it turns out that the connection between the notes can often be as important, so digital samplers now focus on the transitions between the notes as much as the notes themselves.

The old approach to speech of getting point in time samples, and then (essentially) morphing between them is no longer being followed for TTS.

Current technology is based on being able to take a training set of data (usually hours and hours of spoken text), and slice it into segments.

When given text to speak, the program recombines the training material using probability to create synthetic speech. So none of the data is discarded, and the transitions between the sounds are preserved.

Sinsy essentially creates spoken word and warps it into sung speech via pitch shifting.

But... the "sound" of a singer isn't just based on what they sound like, but the sorts of musical decisions they make - holding notes a bit longer in some places, adding vibrato in others... There are a lot of possibilities, and the task of creating and classifying a source database of material would be quite difficult - especially when the singer you want to emulate is dead!

It turns out that (like many things) that people were a bit too optimistic about how easy a task this would be to solve.


-- David Cuny
My virtual singer development blog

Vocal control, you say. Never heard of it. Is that some kind of ProTools thing?
Off-Topic
Joined: Sep 2010
Posts: 6,642
dcuny Offline OP
Veteran
OP Offline
Veteran
Joined: Sep 2010
Posts: 6,642
Originally Posted By: JimFogle
Getting closer to my wanting to snap my fingers in time with the singer. cool

Thanks! "Twinkle, Twinkle Little Star" isn't the best song to use a demo, but it helps me hear what's changed from one version to the next.

Hank Sims has been doing beta testing on this for me, and sent me a number of songs, including "Route 66" and "Tennesee Waltz". Often they'll identify some sort of bug in synSinger, but it's fun to hear it singing various songs.

As it's currently written, synSinger has a bit of a drawl, especially on sonorants like L and Y. The end result is he sounds a bit like a congested version of Kermit the Frog. grin One of these days I'll get around to implementing anti-resonators to better simulate the nose, but there are always more serious bugs to fix first.


-- David Cuny
My virtual singer development blog

Vocal control, you say. Never heard of it. Is that some kind of ProTools thing?
Off-Topic
Joined: Sep 2010
Posts: 6,642
dcuny Offline OP
Veteran
OP Offline
Veteran
Joined: Sep 2010
Posts: 6,642
Here's a more "finger snapping" song that Hank Sims sent me. (Thanks, Hank! laugh )

Sorry for the poor quality, I just happened to have it handy:

Any Time

Written in 1921 by Herbert Happy Lawson, so it's in the public domain. I'll try to get a newer version (with less glitches) up eventually.

I've fixed a lot of the "clicks" in the current version, but there are still issues with some sounds being clipped.

The "drawl" I mentioned before is because how dipthongs are handled. When you sing something like "TIME", the I is essentially two different sounds - AH-EE. The AH sound is supposed to be held until the last second and the EE only gets a short duration, but synSinger currently splits them about 50/50.

I sort of like the effect, but it really should be fixed at some point.


-- David Cuny
My virtual singer development blog

Vocal control, you say. Never heard of it. Is that some kind of ProTools thing?
Off-Topic
Joined: Aug 2014
Posts: 1
M
Newbie
Offline
Newbie
M
Joined: Aug 2014
Posts: 1
All this (and your personal blog) is truely interesting, but I did'nt be able to find WHERE you post your SynSinger software versions ?
I would be extremely excited if I could test it by myself !

Off-Topic
Joined: Sep 2010
Posts: 6,642
dcuny Offline OP
Veteran
OP Offline
Veteran
Joined: Sep 2010
Posts: 6,642
Work on synSinger is currently on hold for the summer, but I'll start working on it again at some point when the coding bug bites again.

I haven't posted the source publicly yet, as it's still very much beta software.

But you can find the most current copy here: synSinger.zip

The .zip file contains the executable, and instructions for installation and use with BiaB. If you have any problems, you can drop me an email.


-- David Cuny
My virtual singer development blog

Vocal control, you say. Never heard of it. Is that some kind of ProTools thing?
Off-Topic
Joined: Dec 2003
Posts: 8,987
Veteran
Offline
Veteran
Joined: Dec 2003
Posts: 8,987
As a former singer and currently mute, I've followed David's experiments with keen interest. Kudos are certainly in order, David.

www.vocalid.org is currently collecting voice donations and I joined their huge database of voice samples today. This is the genetic reply received today. I submit it here because of the importance of the highlighted text.

"Thank you for wanting to be part of VocaliD and The Human Voicebank Initiative - our effort to collect voice samples from donors like yourself.

At present, we are raising funds to launch the voice drive and store all the data. We are also developing tools to collect high quality speech recordings without requiring donors to visit a professional studio. We hope to have the tools ready in the near future and will
keep you abreast on our progress. In the mean time, we could use your help in spreading the word about the project and recruiting others who may want to contribute.

Together we can change lives!

Previous Thread
Next Thread
Go To

Link Copied to Clipboard
ChatPG

Ask sales and support questions about Band-in-a-Box using natural language.

ChatPG's knowledge base includes the full Band-in-a-Box User Manual and sales information from the website.

PG Music News
Update Your PowerTracks Pro Audio 2024 Today!

Add updated printing options, enhanced tracks settings, smoother use of MGU and SGU (BB files) within PowerTracks, and more with the latest PowerTracks Pro Audio 2024 update!

Learn more about this free update for PowerTracks Pro Audio & download it at www.pgmusic.com/support_windows_pt.htm#2024_5

The Newest RealBand 2024 Update is Here!

The newest RealBand 2024 Build 5 update is now available!

Download and install this to your RealBand 2024 for updated print options, streamlined loading and saving of .SGU & MGU (BB) files, and to add a number of program adjustments that address user-reported bugs and concerns.

This free update is available to all RealBand 2024 users. To learn more about this update and download it, head to www.pgmusic.com/support.realband.htm#20245

The Band-in-a-Box® Flash Drive Backup Option

Today (April 5) is National Flash Drive Day!

Did you know... not only can you download your Band-in-a-Box® Pro, MegaPAK, or PlusPAK purchase - you can also choose to add a flash drive backup copy with the installation files for only $15? It even comes with a Band-in-a-Box® keychain!

For the larger Band-in-a-Box® packages (UltraPAK, UltraPAK+, Audiophile Edition), the hard drive backup copy is available for only $25. This will include a preinstalled and ready to use program, along with your installation files.

Backup copies are offered during the checkout process on our website.

Already purchased your e-delivery version, and now you wish you had a backup copy? It's not too late! If your purchase was for the current version of Band-in-a-Box®, you can still reach out to our team directly to place your backup copy order!

Note: the Band-in-a-Box® keychain is only included with flash drive backup copies, and cannot be purchased separately.

Handy flash drive tip: Always try plugging in a USB device the wrong way first? If your flash drive (or other USB plug) doesn't have a symbol to indicate which way is up, look for the side with a seam on the metal connector (it only has a line across one side) - that's the side that either faces down or to the left, depending on your port placement.

Update your Band-in-a-Box® 2024 for Windows® Today!

Update your Band-in-a-Box® 2024 for Windows for free with build 1111!

With this update, there's more control when saving images from the Print Preview window, we've added defaults to the MultiPicker for sorting and font size, updated printing options, updated RealTracks and other content, and addressed user-reported issues with the StylePicker, MIDI Soloists, key signature changes, and more!

Learn more about this free update for Band-in-a-Box® 2024 for Windows at www.pgmusic.com/support_windowsupdates.htm#1111

Band-in-a-Box® 2024 Review: 4.75 out of 5 Stars!

If you're looking for a in-depth review of the newest Band-in-a-Box® 2024 for Windows version, you'll definitely find it with Sound-Guy's latest review, Band-in-a-Box® 2024 for Windows Review: Incredible new capabilities to experiment, compose, arrange and mix songs.

A few excerpts:
"The Tracks view is possibly the single most powerful addition in 2024 and opens up a new way to edit and generate accompaniments. Combined with the new MultiPicker Library Window, it makes BIAB nearly perfect as an 'intelligent' composer/arranger program."

"MIDI SuperTracks partial generation showing six variations – each time the section is generated it can be instantly auditioned, re-generated or backed out to a previous generation – and you can do this with any track type. This is MAJOR! This takes musical experimentation and honing an arrangement to a new level, and faster than ever."

"Band in a Box continues to be an expansive musical tool-set for both novice and experienced musicians to experiment, compose, arrange and mix songs, as well as an extensive educational resource. It is huge, with hundreds of functions, more than any one person is likely to ever use. Yet, so is any DAW that I have used. BIAB can do some things that no DAW does, and this year BIAB has more DAW-like functions than ever."

Convenient Ways to Listen to Band-in-a-Box® Songs Created by Program Users!

The User Showcase Forum is an excellent place to share your Band-in-a-Box® songs and listen to songs other program users are creating!

There are other places you can listen to these songs too! Visit our User Showcase page to sort by genre, artist (forum name), song title, and date - each listing will direct you to the forum post for that song.

If you'd rather listen to these songs in one place, head to our Band-in-a-Box® Radio, where you'll have the option to select the genre playlist for your listening pleasure. This page has SoundCloud built in, so it won't redirect you. We've also added the link to the Artists SoundCloud page here, and a link to their forum post.

We hope you find some inspiration from this amazing collection of User Showcase Songs!

Congratulations to the 2023 User Showcase Award Winners!

We've just announced the 2023 User Showcase Award Winners!

There are 45 winners, each receiving a Band-in-a-Box 2024 UltraPAK! Read the official announcement to see if you've won.

Our User Showcase Forum receives more than 50 posts per day, with people sharing their Band-in-a-Box songs and providing feedback for other songs posted.

Thank you to everyone who has contributed!

Forum Statistics
Forums66
Topics81,612
Posts735,083
Members38,515
Most Online2,537
Jan 19th, 2020
Newest Members
TonyInManchester, jslynbrrs01, amdwilsns01, Juan Jose, BroDon
38,515 Registered Users
Top Posters(30 Days)
MarioD 185
DC Ron 101
dcuny 74
DrDan 74
Today's Birthdays
brijb20, Erik S. te M.
Powered by UBB.threads™ PHP Forum Software 7.7.5