Previous Thread
Index
Next Thread
Print Thread
Go To
Recording, Mixing, Performance and Production
Joined: Jan 2002
Posts: 7,913
R
Veteran
OP Offline
Veteran
R
Joined: Jan 2002
Posts: 7,913
Fellow home recordists:

I found out about this project through a TED talk. It's an initiative to vastly expand the access to and variety of recorded human speech for use for those that require speech synthesis/assistance.

The main project page: https://vocalid.co/

The page where we can donate our voices: https://vocalid.co/voicebank

So many of us have better than average recording setups at home - let's band together to provide well-recorded speech to those that need it.

-Scott

Recording, Mixing, Performance and Production
Joined: Dec 2003
Posts: 8,987
Veteran
Offline
Veteran
Joined: Dec 2003
Posts: 8,987
Thanks, Scott!

Folks marvel at the capabilities of my Dynavox Maestro(r) Speech Synthesis Device but even including the recent advancements in DSP (Digital Speech Processing), we both know that the technology is in an infantile state of development and progressing exponentially. What is possible today will be outdone in a few months. Already, my Maestro can be completely controlled by eye movements without connections.

I am privileged to see some R&D projects currently under development and they are astonishing.

I demonstrate the device at VA Medical Centers for veterans who have become speech deprived. To think that we will soon SING is something so wonderful.

Recording, Mixing, Performance and Production
Joined: Dec 2003
Posts: 8,987
Veteran
Offline
Veteran
Joined: Dec 2003
Posts: 8,987
I'm envisioning the impact that Scott, Dr Gannon, Matt Finley, David Cuny, and others would have one this technology. Wow! I might sing again!

Dr Donald K. Reynolds, Dean of the College of Engineering at UW, said that a primary purpose of higher education is to prevent us from "...trying to reinvent the wheel!" So it behooves us to know and understand the current state-of-the-art. Perhaps Scott, as an Audio Engineer, would be best qualified for that role.

Recording, Mixing, Performance and Production
Joined: May 2015
Posts: 10
Newbie
Offline
Newbie
Joined: May 2015
Posts: 10
Thanks for posting this. I put it on my Facebook page with a shout-out to the singers, actors and voiceover folks I know to get involved, which some have apparently done.

Cheers,

Ed


***********************
"We know what we are, but not what we may be"

- Noted bluesman Blind Will Shakespeare
***********************
Recording, Mixing, Performance and Production
Joined: Sep 2010
Posts: 6,665
Veteran
Offline
Veteran
Joined: Sep 2010
Posts: 6,665
In this project, it looks like they are creating collections of phonetic units, and classifying the donor parameters to build collections. It seems like it would be pretty standard stuff, but there might be some "secret sauce" that I'm unaware of.

Along those lines, I've read a paper where the researcher replaced key phonemes in otherwise generic synthesized output, and was able to overlay the "personality" of the voice. So they might be taking advantage of that as well.

Vocaloid is still the "gold standard" of singing resynthesis, as far as I know, and the process takes months to create a good voice donor. It also helps if you've got native english speakers on the team.

If you're interested, Avanna is currently on sale for $49, and she's probably the best english vocaloid currently on the market. It only comes with the "tiny" editor, which is limited to creating 18 bars at a time, so you'd have to stitch the output together to make a full song. Personally, that's not much of a limitation, because I prefer to build melodies one section at a time.

I've been working for the last couple of weeks trying to get synSinger to automatically extract parameters from audio samples, but have been getting mixed results. If there's anyone with some audio/programming background, I'd love to hear from them!

As far as BiaB goes for vocal synthesis, the MusicXML it creates is pretty broken. I've reported and re-reported bugs (wrong pitches, rests between syllables) over a year ago, and seen no fixes.

It's very frustrating, especially since I'm trying to use BiaB to generate output for synSinger. frown


-- David Cuny
My virtual singer development blog

Vocal control, you say. Never heard of it. Is that some kind of ProTools thing?
Recording, Mixing, Performance and Production
Joined: Jun 2012
Posts: 3,570
J
Veteran
Offline
Veteran
J
Joined: Jun 2012
Posts: 3,570
David, thanks for that info...Avanna is very interesting! Do you know if it is limited unless you buy Vocaloid 3 separately? Also, have you ever checked out this product, http://realitone.com/blue/ ? I was thinking of buying it during their sale.

Recording, Mixing, Performance and Production
Joined: Sep 2010
Posts: 6,665
Veteran
Offline
Veteran
Joined: Sep 2010
Posts: 6,665
Originally Posted By: JohnJohnJohn
David, thanks for that info...Avanna is very interesting! Do you know if it is limited unless you buy Vocaloid 3 separately? Also, have you ever checked out this product, http://realitone.com/blue/ ? I was thinking of buying it during their sale.

Avanna comes with the free "tiny" editor by default. There are two limitations with the "tiny" editor:
  • You can only work with one vocal track per track, and
  • You only get 18 bars per session

Since I work in a DAW, it's not really a problem for me to assemble the parts from pieces, and layer the tracks. You can also import a single audio track, so you can play the backing tracks as you're fiddling with the vocals.

I've not heard of Realivox. Props to the video demo - they do a good job explaining what the product can't do. Vocaloid doesn't have those limitations - it automatically anticipates the consonants. Plus, they state: "Finally, your search for a library that says "oosht" is over!" laugh

The legato from pitch to pitch isn't also as nice as Vocaloid. On the other hand, Realivox looks pretty fun to play.

So if you're looking for a nice background vocal, Realivox is probably a better choice than Vocaloid, as long as you're aware of the tool's limitation.


-- David Cuny
My virtual singer development blog

Vocal control, you say. Never heard of it. Is that some kind of ProTools thing?
Recording, Mixing, Performance and Production
Joined: Jan 2002
Posts: 7,913
R
Veteran
OP Offline
Veteran
R
Joined: Jan 2002
Posts: 7,913
I'd like to steer the conversation back to the voicebank project.

Recording, Mixing, Performance and Production
Joined: Dec 2003
Posts: 8,987
Veteran
Offline
Veteran
Joined: Dec 2003
Posts: 8,987
I posted it among my HS Classmates and have been getting a lot of interest. I posted VocalID's promo today.

Sorry if I hijacked your thread, it was not intentional.

Recording, Mixing, Performance and Production
Joined: Jan 2002
Posts: 7,913
R
Veteran
OP Offline
Veteran
R
Joined: Jan 2002
Posts: 7,913
Don, no hi-jack.

If you, the reader are just arriving at this thread at this post, please hit the first post links and consider donating your voice to the voice-bank.

If nothing else, watch the TED talk video: http://www.ted.com/talks/rupal_patel_synthetic_voices_as_unique_as_fingerprints?language=en

See if that doesn't inspire you...

Recording, Mixing, Performance and Production
Joined: Jan 2002
Posts: 7,913
R
Veteran
OP Offline
Veteran
R
Joined: Jan 2002
Posts: 7,913
I recorded my first 500 sentences tonight. Note, make yourself comfortable so that you can read the sentences and read-aloud while recording without much head movement. However, don't put the mic right in front of your monitor. If you do, there will be some notch filtering that can occur. The recording 'studio' that is part of the voicebank is quite simple to use. Note to the interested, it's no small task to record 500 sentences - it took me about an hour and a half to get it done. The overall amount is roughly 3500 sentences! So, I'm looking at probably 8 hours of time that I'll be putting in to this effort. I will say that the first 150 sentences or so took longer because of the way I was oriented and had to turn away from the monitor for each sentence. The next 350 went by much faster.

Previous Thread
Next Thread
Go To

Link Copied to Clipboard
ChatPG

Ask sales and support questions about Band-in-a-Box using natural language.

ChatPG's knowledge base includes the full Band-in-a-Box User Manual and sales information from the website.

PG Music News
User Video: Next-Level AI Music Editing with ACE Studio and Band-in-a-Box®

The Bob Doyle Media YouTube channel is known for demonstrating how you can creatively incorporate AI into your projects - from your song projects to avatar building to face swapping, and more!

His latest video, Next-Level AI Music Editing with ACE Studio and Band-in-a-Box, he explains in detail how you can use the Melodist feature in Band-in-a-Box with ACE Studio. Follow along as he goes from "nothing" to "something" with his Band-in-a-Box MIDI Melodist track, using ACE Studio to turn it into a vocal track (or tracks, you'll see) by adding lyrics for those notes that will trigger some amazing AI vocals!

Watch: Next-Level AI Music Editing with ACE Studio and Band-in-a-Box


Band-in-a-Box® 2024 German for Windows is Here!

Band-in-a-Box® 2024 für Windows Deutsch ist verfügbar!

Wir waren fleißig und haben über 50 neue Funktionen und eine erstaunliche Sammlung neuer Inhalte hinzugefügt, darunter 222 RealTracks, neue RealStyles, MIDI SuperTracks, Instrumental Studies, "Songs with Vocals" Artist Performance Sets, abspielbare RealTracks Set 3, abspielbare RealDrums Set 2, zwei neue Sets von "RealDrums Stems", XPro Styles PAK 6, Xtra Styles PAK 17 und mehr!

Paket | Was ist Neu

Update Your PowerTracks Pro Audio 2024 Today!

Add updated printing options, enhanced tracks settings, smoother use of MGU and SGU (BB files) within PowerTracks, and more with the latest PowerTracks Pro Audio 2024 update!

Learn more about this free update for PowerTracks Pro Audio & download it at www.pgmusic.com/support_windows_pt.htm#2024_5

The Newest RealBand 2024 Update is Here!

The newest RealBand 2024 Build 5 update is now available!

Download and install this to your RealBand 2024 for updated print options, streamlined loading and saving of .SGU & MGU (BB) files, and to add a number of program adjustments that address user-reported bugs and concerns.

This free update is available to all RealBand 2024 users. To learn more about this update and download it, head to www.pgmusic.com/support.realband.htm#20245

The Band-in-a-Box® Flash Drive Backup Option

Today (April 5) is National Flash Drive Day!

Did you know... not only can you download your Band-in-a-Box® Pro, MegaPAK, or PlusPAK purchase - you can also choose to add a flash drive backup copy with the installation files for only $15? It even comes with a Band-in-a-Box® keychain!

For the larger Band-in-a-Box® packages (UltraPAK, UltraPAK+, Audiophile Edition), the hard drive backup copy is available for only $25. This will include a preinstalled and ready to use program, along with your installation files.

Backup copies are offered during the checkout process on our website.

Already purchased your e-delivery version, and now you wish you had a backup copy? It's not too late! If your purchase was for the current version of Band-in-a-Box®, you can still reach out to our team directly to place your backup copy order!

Note: the Band-in-a-Box® keychain is only included with flash drive backup copies, and cannot be purchased separately.

Handy flash drive tip: Always try plugging in a USB device the wrong way first? If your flash drive (or other USB plug) doesn't have a symbol to indicate which way is up, look for the side with a seam on the metal connector (it only has a line across one side) - that's the side that either faces down or to the left, depending on your port placement.

Update your Band-in-a-Box® 2024 for Windows® Today!

Update your Band-in-a-Box® 2024 for Windows for free with build 1111!

With this update, there's more control when saving images from the Print Preview window, we've added defaults to the MultiPicker for sorting and font size, updated printing options, updated RealTracks and other content, and addressed user-reported issues with the StylePicker, MIDI Soloists, key signature changes, and more!

Learn more about this free update for Band-in-a-Box® 2024 for Windows at www.pgmusic.com/support_windowsupdates.htm#1111

Band-in-a-Box® 2024 Review: 4.75 out of 5 Stars!

If you're looking for a in-depth review of the newest Band-in-a-Box® 2024 for Windows version, you'll definitely find it with Sound-Guy's latest review, Band-in-a-Box® 2024 for Windows Review: Incredible new capabilities to experiment, compose, arrange and mix songs.

A few excerpts:
"The Tracks view is possibly the single most powerful addition in 2024 and opens up a new way to edit and generate accompaniments. Combined with the new MultiPicker Library Window, it makes BIAB nearly perfect as an 'intelligent' composer/arranger program."

"MIDI SuperTracks partial generation showing six variations – each time the section is generated it can be instantly auditioned, re-generated or backed out to a previous generation – and you can do this with any track type. This is MAJOR! This takes musical experimentation and honing an arrangement to a new level, and faster than ever."

"Band in a Box continues to be an expansive musical tool-set for both novice and experienced musicians to experiment, compose, arrange and mix songs, as well as an extensive educational resource. It is huge, with hundreds of functions, more than any one person is likely to ever use. Yet, so is any DAW that I have used. BIAB can do some things that no DAW does, and this year BIAB has more DAW-like functions than ever."

Forum Statistics
Forums66
Topics81,651
Posts735,440
Members38,526
Most Online2,537
Jan 19th, 2020
Newest Members
theyearofjess, OlvaJownDay, Tranner Track, Ely Bass, Barking
38,525 Registered Users
Top Posters(30 Days)
MarioD 176
DC Ron 100
dcuny 89
rsdean 70
Today's Birthdays
David Robinson, louiep, Ozkar, Timothy W. Cook
Powered by UBB.threads™ PHP Forum Software 7.7.5