Page 1 of 2 1 2 >
You need to be logged in to post on the forum
Topic Options
Index
#393591 - 01/31/17 04:47 PM [Off-Topic] Has anyone used Synsy to synthesize voice to follow the lyrics?
Don Gaynor Offline
Veteran

Registered: 12/10/03
Posts: 7945
Loc: Oklahoma, USA
I'd like to hear examples of what other users have accomplished with Synsy. I feel that Peter implemented the feature, at least in part, to give voice to my music. I'd like to show my appreciation by singing a song to/for Peter.

Donny

Top
#393643 - 02/01/17 03:18 AM [Off-Topic] Re: Has anyone used Synsy to synthesize voice to follow the lyrics? [Re: Don Gaynor]
VideoTrack Offline
Veteran

Registered: 06/05/12
Posts: 8302
Loc: Melbourne, Australia
Excellent idea Don, and absolutely very commendable.

My results with Synsy have been less than desirable, partly possibly due to the Japanese sounding phonemes that have been used.

More information on Synsy is available here

Of course, YMMV

Fellow forum fember David Cuny has also been developing SynSinger, a similar product and one you might explore also.


_________________________

BIAB, RB 2018(Audiophile), Sonar Platinum, Izotope Prod. Bundle, Roland RD-1000, Synthogy Ivory, Kontakt, Focusrite 18i20, KetronSD2, KorgX3R, RodeNGT2, AM802mixer, NS40M Studio Monitors, Pioneer Active Mons, AKG K271 Studio H'phones

Top
#393655 - 02/01/17 05:16 AM [Off-Topic] Re: Has anyone used Synsy to synthesize voice to follow the lyrics? [Re: VideoTrack]
Don Gaynor Offline
Veteran

Registered: 12/10/03
Posts: 7945
Loc: Oklahoma, USA
Originally Posted By: VideoTrack
Excellent idea Don, and absolutely very commendable.

My results with Synsy have been less than desirable, partly possibly due to the Japanese sounding phonemes that have been used.

More information on Synsy is available here

Of course, YMMV

Fellow forum fember David Cuny has also been developing SynSinger, a similar product and one you might explore also.



Ian,

Yes, I've been working with David Cuny.

Voice synthesis, especially singing, is in it's infancy. I'm hoping to get David connected to the engineering staff at Dynavox-Tobii who have developed the most realistic-sounding speaking voice that I've ever heard. It seems to me that singing voices would be a logical progression. I don't know if David was successful in contacting their R&D engineers.

Dynavox was recently acquired by a Japanese company, Tobii, so I'm anxious to see/hear what they do with the technology.

Another interesting technology is a voice bank (I've forgotten the name) where they take snippets of volunteer's speech then concatenate them and process the results through a Melodyn-type processor. That idea shows a great potential.

Donny

Top
#393747 - 02/01/17 12:46 PM [Off-Topic] Re: Has anyone used Synsy to synthesize voice to follow the lyrics? [Re: Don Gaynor]
dcuny Online   content
Veteran

Registered: 09/27/10
Posts: 2363
Loc: Sacramento, California
I've done a couple songs using Sinsy - for example, Words Like Smoke.

The early BiaB support for Sinsy had a number of problems which might have turned people off from using it. For example, syllables had short rests between them, so words often were mispronounced. There was a bug which caused some notes to be exported as naturals instead of flats. I think these have both been corrected, although I've never gotten confirmation back from my bug reports.

I wish that the people working on Sinsy had used a native English speaker, because the /R/ and /L/ aren't very distinct. But the voices are very natural, and there are a number of YouTube videos showing off what's possible.
_________________________
-- David Cuny
My virtual singer development blog

Vocal control, you say. Never heard of it. Is that some kind of ProTools thing?

Top
#393752 - 02/01/17 01:12 PM [Off-Topic] Re: Has anyone used Synsy to synthesize voice to follow the lyrics? [Re: Don Gaynor]
dcuny Online   content
Veteran

Registered: 09/27/10
Posts: 2363
Loc: Sacramento, California
Originally Posted By: Don Gaynor
I'm hoping to get David connected to the engineering staff at Dynavox-Tobii who have developed the most realistic-sounding speaking voice that I've ever heard. It seems to me that singing voices would be a logical progression. I don't know if David was successful in contacting their R&D engineers.

Anyone who's familiar with voice synthesis won't have trouble finding out about Sinsy - there's a ton of information on the internet. Basically, it uses HMM (Hidden Markov Model) synthesis and then modifies it from spoken to sung speech.

The source for Sinsy has been released on SourceForge. Unfortunately, it's beyond my skill to build it, and they apparently only included a single Japanese voice.

Originally Posted By: Don Gaynor
Another interesting technology is a voice bank (I've forgotten the name) where they take snippets of volunteer's speech then concatenate them and process the results through a Melodyne-type processor. That idea shows a great potential.

I've heard demos that have spliced together segments of actual speech phonemes along with formant synthesized speech. The results take on a strong character of the original speaker.

Edit: I see on the Sinsy SourceForge discussion board from a couple weeks ago that they're planning on releasing the English version in the near future. Part of the issue seems to be that the English version was done in an ad-hoc manner.

They suggest that if you can't wait that long, you could do it yourself by modifying the source code. crazy


Edited by dcuny (02/01/17 03:48 PM)
Edit Reason: Additional information about English Sinsy
_________________________
-- David Cuny
My virtual singer development blog

Vocal control, you say. Never heard of it. Is that some kind of ProTools thing?

Top
#393773 - 02/01/17 03:25 PM [Off-Topic] Re: Has anyone used Synsy to synthesize voice to follow the lyrics? [Re: dcuny]
Don Gaynor Offline
Veteran

Registered: 12/10/03
Posts: 7945
Loc: Oklahoma, USA
David,

I believe the name of the project is VocalID (qv).

They are still in the process of gathering voice samples.

Donny

Top
#393820 - 02/01/17 07:00 PM [Off-Topic] Re: Has anyone used Synsy to synthesize voice to follow the lyrics? [Re: Don Gaynor]
Jim Fogle Offline
Veteran

Registered: 08/20/11
Posts: 4021
Loc: Winston-Salem, NC USA
Originally Posted By: Don Gaynor

Another interesting technology is a voice bank (I've forgotten the name) where they take snippets of volunteer's speech then concatenate them and process the results through a Melodyn-type processor. That idea shows a great potential. Donny


Don,

I believe you maybe thinking of ++ Vocal ID ++. Another possibility is ++ Model Talker ++
_________________________
Jim Fogle
2018 BiaB (520) UltraPlusPak RB 2018 (Build 5)
Cakewalk by Bandlab - Sonar Home Studio - Cakewalk Music Creator 6 - Audacity - Zoom MRS-8 recorder
i3 laptop, 64bit Win 7, 8 GB ram, 480GB SSD
Music at: http://fogle622.wix.com/fogle622-audio-home

Top
#393835 - 02/01/17 07:44 PM [Off-Topic] Re: Has anyone used Synsy to synthesize voice to follow the lyrics? [Re: Jim Fogle]
Don Gaynor Offline
Veteran

Registered: 12/10/03
Posts: 7945
Loc: Oklahoma, USA
Originally Posted By: Jim Fogle
Originally Posted By: Don Gaynor

Another interesting technology is a voice bank (I've forgotten the name) where they take snippets of volunteer's speech then concatenate them and process the results through a Melodyn-type processor. That idea shows a great potential. Donny


Don,

I believe you maybe thinking of ++ Vocal ID ++. Another possibility is ++ Model Talker ++

Charlie,

Yes, Vocal ID is the one I had in mind.

I am an honorary member but I've fallen behind in their progress. They have been working primarily on speech and not singing which seems a logical progression.

Thanks,

Donny

Top
#393858 - 02/01/17 11:57 PM [Off-Topic] Re: Has anyone used Synsy to synthesize voice to follow the lyrics? [Re: Don Gaynor]
vzudell Offline
Apprentice

Registered: 11/01/00
Posts: 263
Loc: Otter Lake, Michigan
Hi Don, I have been working with Synsy for the last couple of days and my problem is that the entire vocal cuts out except for a faint "tsk" sound after every 5 or 6 bars. The phrases that do sound are quite clear although there is quite an "accent" to the words. I've downloaded a new version several times and it continues to cut out every few bars. I'm beginning to wonder if it is a problem with the track itself. I checked the Audio Edit and there are spaces where it shows almost no activity and then it will pick up again several bars later. Can't imagine what is causing this. Would you or any of your friends on here care to venture a guess of why this is happening or how to fix it?



Edited by vzudell (02/02/17 12:04 AM)
Edit Reason: added a phrase

Top
#393889 - 02/02/17 07:10 AM [Off-Topic] Re: Has anyone used Synsy to synthesize voice to follow the lyrics? [Re: vzudell]
Don Gaynor Offline
Veteran

Registered: 12/10/03
Posts: 7945
Loc: Oklahoma, USA
Wonderful to hear from you, my friend.

Are you losing your beautiful voice so starting reliance on voice synthesis?

Singing voice as opposed to speaking voice is another world entirely. I just received a new Dynavox 15" Speech Synthesis Device that speaks perfectly. The problem is in making it sing.

I would really like to team David Cuny up with the R&D Engineers at Dynavox-Tobii.

I have an older Dynavox VMax (qv) that you are welcome to have for conversation purposes. Just nod your head and I'll ship it out.

You may enjoy learning that Illinois State University's Dr Kim McCord has honored me by establishing The Don Gaynor Special Needs Music Department. I'm thrilled. Unfortunately, Professor McCord is being forced into early retirement due to serious family health issues and the University has no plans to continue her program, the top-rated such program in the nation.

Again, it's awesome hearing from you.

Appropriate affection.

Donny

Top
#393902 - 02/02/17 09:27 AM [Off-Topic] Re: Has anyone used Synsy to synthesize voice to follow the lyrics? [Re: Don Gaynor]
Don Gaynor Offline
Veteran

Registered: 12/10/03
Posts: 7945
Loc: Oklahoma, USA
Sorry - I thought I was in PM mode. ^^^

Top
#393911 - 02/02/17 11:02 AM [Off-Topic] Re: Has anyone used Synsy to synthesize voice to follow the lyrics? [Re: Don Gaynor]
vzudell Offline
Apprentice

Registered: 11/01/00
Posts: 263
Loc: Otter Lake, Michigan
Yes, Don, I really have no voice quality anymore. I believe it may be a thyroid issue. No trouble speaking just the hoarseness that keeps me from a good vocal quality.
I am finding it more and more difficult to learn to use these new technical advances so though I appreciate your offer of the Dynavox, I fear that it wouldn't be much use to me and perhaps someone else could make better use of it than I. I haven't even mastered all the things available to me in BIAB. There is just so much to learn and absorb so it can be put to use but I'm working on it as time allows.

Top
#393915 - 02/02/17 11:17 AM [Off-Topic] Re: Has anyone used Synsy to synthesize voice to follow the lyrics? [Re: vzudell]
dcuny Online   content
Veteran

Registered: 09/27/10
Posts: 2363
Loc: Sacramento, California
Originally Posted By: vzudell
Would you or any of your friends on here care to venture a guess of why this is happening or how to fix it?

I'd be happy to have a look at it. Could you send the Sound.XML file that BiaB generates? If you installed BiaB on your C: drive, You should be able to find the file here:

C:\bb\data\SRequest\Sound.XML

If not, you can find it by going into BIAB, choosing Lyrics from the menu, and selecting Vocal Synth-Manual Mode... from the dropdown.

BiaB will display a dialog box with the following message:

C:\bb\data\SRequest\Sound.XML is now generated

This indicates where the file is located.

My own voice synthesis program has a few timing bugs I'm still struggling to track down. The voice quality is OK, but it's hard to understand at fast tempos, and is a lot more synthetic than Sinsy.

But if you're interested in trying it out, let me know. The primary voice is male, but I've got the option for a female voice. Here's an example of what it sounds like: synSinger Female Voice Demo. Obviously, the female voice needs more work.
_________________________
-- David Cuny
My virtual singer development blog

Vocal control, you say. Never heard of it. Is that some kind of ProTools thing?

Top
#393949 - 02/02/17 02:24 PM [Off-Topic] Re: Has anyone used Synsy to synthesize voice to follow the lyrics? [Re: vzudell]
Don Gaynor Offline
Veteran

Registered: 12/10/03
Posts: 7945
Loc: Oklahoma, USA
Originally Posted By: vzudell
Yes, Don, I really have no voice quality anymore. I believe it may be a thyroid issue. No trouble speaking just the hoarseness that keeps me from a good vocal quality.
I am finding it more and more difficult to learn to use these new technical advances so though I appreciate your offer of the Dynavox, I fear that it wouldn't be much use to me and perhaps someone else could make better use of it than I. I haven't even mastered all the things available to me in BIAB. There is just so much to learn and absorb so it can be put to use but I'm working on it as time allows.

Val,

Actually, Dynavox is not very technical - it speaks what you type into it's touch-screen keyboard. Common phrases are pre-programmed and assigned to hot keys. Literally hundreds of common phrases make typing virtually unnecessary.

Also, it's not a toy. It's a full blown Windows 7 computer with WIFI and a fairly decent audio amplifier.

I would be happy to give it to you. It's just gathering dust because I have three. I will have to locate the charger/adapter though.

I'm told that my new 15" cost $15K so the VA is taking excellent care of your old Irish friend.

Donny

Top
#393952 - 02/02/17 02:50 PM [Off-Topic] Re: Has anyone used Synsy to synthesize voice to follow the lyrics? [Re: dcuny]
Hugh2 Offline
Apprentice

Registered: 04/24/16
Posts: 232
Hi Dcuny
Oh I tried it a couple of times but I didnt think you could get it as good as that, words like smoke is really nice song.If you take away the japanese sound its very good.
Hugh

Top
#394019 - 02/02/17 10:24 PM [Off-Topic] Re: Has anyone used Synsy to synthesize voice to follow the lyrics? [Re: dcuny]
vzudell Offline
Apprentice

Registered: 11/01/00
Posts: 263
Loc: Otter Lake, Michigan
Thanks for responding to my post and for your offer to take a look at my problem. I have just spent the whole day re-downloading all my BIAB files to the C drive, hoping this may make a difference. I had been using the hard drive version where I first experienced the problem so I dug out my back up copy and tried it on that, thinking perhaps some files had become corrupted on the original hard drive version. But It did the same thing with my back up copy so I have been re-downloading everything and putting it in my C drive and when I get that finished, I'll try Synsy again. If that hasn't solved the problem, I will get back to you and send that file that you needed. Thanks again for offering to help.
I did go and listen to the female voice in your It's not bad but I use a male vocal for a lot of my songs so I would be more interested in hearing the male voice. I'm wondering if maybe some malware got into my computer when last week one of those scams for computer repair came up on my screen and locked my computer and I had to just shut it down from the task manager. It messed with the files in the boot sector and I had to use the restore and repair to get it back up and running.

Top
#394020 - 02/02/17 10:50 PM [Off-Topic] Re: Has anyone used Synsy to synthesize voice to follow the lyrics? [Re: Don Gaynor]
vzudell Offline
Apprentice

Registered: 11/01/00
Posts: 263
Loc: Otter Lake, Michigan
Don, I want to thank you again for your offer of the Dynavox. I became interested when I learned that it was Windows 7, because that is what I'm familiar with. I tried Windows 10 and did not like it at all. If you can wait for about 3 months before you send it I will then have a place to put it where I could use it. We hope to add another room onto our apartment this spring. Hubby has been drawing up plans because we are just so "stuffed" into our tiny apartment since we converted my (computer room, music room, office) into a room for our little great grand daughter and moved everything into our already overflowing bedroom. One can hardly move around to find everything. That will give you some time to find the adapter/charger too! Thanks again!
____Val

Top
#394022 - 02/03/17 12:16 AM [Off-Topic] Re: Has anyone used Synsy to synthesize voice to follow the lyrics? [Re: vzudell]
dcuny Online   content
Veteran

Registered: 09/27/10
Posts: 2363
Loc: Sacramento, California
Originally Posted By: vzudell
I did go and listen to the female voice in your It's not bad but I use a male vocal for a lot of my songs so I would be more interested in hearing the male voice.

Here's a link to the male voice: Twinkle, Twinkle, Little Star #16.
_________________________
-- David Cuny
My virtual singer development blog

Vocal control, you say. Never heard of it. Is that some kind of ProTools thing?

Top
#394042 - 02/03/17 05:32 AM [Off-Topic] Re: Has anyone used Synsy to synthesize voice to follow the lyrics? [Re: vzudell]
Don Gaynor Offline
Veteran

Registered: 12/10/03
Posts: 7945
Loc: Oklahoma, USA
Originally Posted By: vzudell
Don, I want to thank you again for your offer of the Dynavox. I became interested when I learned that it was Windows 7, because that is what I'm familiar with. I tried Windows 10 and did not like it at all. If you can wait for about 3 months before you send it I will then have a place to put it where I could use it. We hope to add another room onto our apartment this spring. Hubby has been drawing up plans because we are just so "stuffed" into our tiny apartment since we converted my (computer room, music room, office) into a room for our little great grand daughter and moved everything into our already overflowing bedroom. One can hardly move around to find everything. That will give you some time to find the adapter/charger too! Thanks again!
____Val

Dear Val,

My brief description doesn't do the Dynavox V-Max justice. It can be configured for hands-free Eye Tracking (with a separate accessory). It has WIFI for built-in internet access. I will also include a WIFI Range Extender so you can use it outdoors (within line of sight). It has a scratch resistant touch screen and 2 extra USB Ports for other accessories such as a WIFI or Bluetooth wireless keyboard.

Here is a picture and complete details.

http://www.dynavoxtech.com/products/vmaxplus/specs/

There is an 1800 page Owners' Manual pre-loaded on it's hard drive.

Don

PS: I should mention - It's CPU (Intel Adam) is NOT sufficiently robust to run BIAB.


Edited by Don Gaynor (02/03/17 06:06 AM)

Top
#394188 - 02/03/17 11:15 PM [Off-Topic] Re: Has anyone used Synsy to synthesize voice to follow the lyrics? [Re: Don Gaynor]
vzudell Offline
Apprentice

Registered: 11/01/00
Posts: 263
Loc: Otter Lake, Michigan
Thanks Don for sending that link! I've been checking it out and I see that there are two ways to order it so that you can do more than just the "speech" on it. So is this one standard or dedicated? I'm thinking that the standard would allow for a game of Solitaire now and then, Am I correct? I think I should send you a request on Facebook to continue our conversations. OK? Been working on downloading BIAB files to my C: drive so then I can try the Sensy again. I discovered today that my computer had been invaded by malicious code that was not caught by my Anti-virus so I changed my antivirus to Kaspersky today and it immediately caught it in the first 5 minutes of the scan! Now I can go back to work.

Val

Top
Page 1 of 2 1 2 >


PG Music News
#TBT - The First Audiophile Edition

A blast from the past... the introduction of the Audiophile Edition with Band-in-a-Box 2008.5!

The first Audiophile purchase included the WAV files for all the RealTracks & RealDrums that were available at that time: RealTracks Sets 1-9 and RealDrums Sets 1-20. It shipped pre-installed on a 250GB USB hard drive - take a look...

Wondering what else was introduced with Band-in-a-Box 2008.5? Click here to see the "Band-in-a-Box 2008.5 New Features List."

RealBand 2018 Interactive Online Upgrade Manual Available!

The newest addition to our Online Manuals support page is the RealBand 2018 New Features Guide!

Just like the other Online Manuals now available on our Support page, this Upgrade Manual can be easily navigated by chapter, or using the main Table of Contents window!

New Interactive Online Band-in-a-Box® 2018 Manual for Mac!

We've added an Online Manuals option to our Support page, where you can access an interactive online Band-in-a-Box® 2018 for Mac User's Guide!

The Online Manual can be easily navigated by chapter, or using the main Table of Contents window! Also available on our Online Manuals page is the PDF files for Band-in-a-Box® 2017-2018 Full manuals & Upgrade manuals.

User Feedback - Run as Administrator

Our Forum is a great resource for all your Band-in-a-Box questions (and a GREAT place to connect with other program users!)

Among the many forums available, we have a User-to-User Tips & Tricks forum - perfect for sharing your own technical tips and tricks for any PG Music product!

Like the recent post by jford: You Should Run BIAB and RealBand As Administrator!

Xtra Styles PAK 5 Song Contest - Over 25 Entries!

We recently launched an Xtra Styles PAK 5 Song Contest with 4 prizes of $150!

So far, there are more than 25 entries! Have a listen to these entries and submit your own song here.

Contest Rules:
-You must own Band-in-a-Box® 2018 along with one or more of the Xtra Styles PAK 5 packages (Country, Jazz, Rock-Pop, MIDI)
-The song you submit must be your own original composition. This could be simply typing in chords to your song and pressing play, but you may also add additional instruments, solo, and/or melody.
-Public domain songs will be accepted.
-Multiple entries are permitted.
-Submit your song to the "Xtra Styles 5 Contest" forum, before the deadline. (This contest runs until September 30th)

For complete information on this contest, click here.

New Online Band-in-a-Box and RealBand Manuals

Do you hate digging around for manuals as much as I do? Now you can access the most recent Band-in-a-Box® and RealBand manuals with just a few clicks on the new Online Manuals section of our website.

The PDF manuals for version 2017 and 2018 are available now. Plus, we're adding online versions of these manuals too! The Band-in-a-Box® 2018 Windows User's Guide is complete, and the Mac User's Guide will be coming very soon. We're even adding a search feature to make it even easier for you to find features that you are looking for - stay tuned!

You Could Win $150 PG Bucks with our Xtra Styles PAK 5 Song Contest!

Want to WIN $150 PG Bucks? Join the entries already submitted into our Xtra Styles PAK 5 Song Contest! When the contest closes on September 30th, we will be picking 4 winners (1 per genre)!

What you need:
-Band-in-a-Box® 2018 UltraPAK or Audiophile Edition
-Xtra Styles PAK 5 Windows | Mac
-a song written using one of the 160+ fully-mixed Styles included in your Xtra Styles PAK 5 purchase.

Complete contest rules list here.

Forum Stats
27959 Members
57 Forums
53917 Topics
445290 Posts

Max Online: 2434 @ 11/14/17 12:37 AM
Newest Members
lazeguy, andymillermusic, Son Lee, 2205, Jay Ostlund

27959 Registered Users
Top Posters (30 Days)
Alyssa - PG Music 506
David Snyder 140
Al-David 138
MarioD 122
Deryk - PG Music 114
Janice & Bud 106
Matt Finley 100
Jim Fogle 97
VideoTrack 94
Kent - PG Music 92
Today's Birthdays
jazzman174, jypi