• Advertisement
  • Popular Tags

  • Popular Now

  • Advertisement
  • Similar Content

    • By Michael Santer
      Hi!
      We're currently two programmers and a game designer working on a turn-based tactics fantasy board game. For reference you can search for images of "Tactics Arena Online", a fairly dated game that used to have a lot of depth and complexity.
      Our goal is to use the same combat concepts, but giving it a much needed modern touch as well as a whole new set of heroes to choose from with additional abilities. The game is a mix of isometric and 3D and we plan to release the game on Steam and hopefully Android & iOS as well.
      We are looking for someone to work with us pro-bono (just like we're doing) as a 3D character artist. The skills needed are creativity, a hard working attitude and an ability to make minor animations (things like idle, walk, block and very rudimentary attack animations). A perk to have would be the ability to make some VFX. If the game makes it on steam and money starts coming in, you'd obviously be compensated for your hard work, but as it stands this is a hobby project to garnish your portfolio.
      A bit more about the game:
      This game will be an online multiplayer game where each user gets to pick up to 10 characters to place on his half of the board (this would be done before even entering matchmaking. Think runes in League of Legends for example). The user can place his 10 units of choice anywhere he likes on his half board. Some units can be used more than once. So if you want 4 knights and 2 mages or even if you want 10 clerics, you can do as you please. You can then save your setups for future use. The goal of the game is to wipe out the enemy team.
      Each character or Hero (except premium and abyss characters) start with 1 ability and they can ascend (either by playing a certain amount of matches with the character or by forcing the ascension with real money) to gain a new ability or passive. Acquiring a new character can be done by using in-game currency that you earn from playing matches or using real money with the exception of Abyss characters which can only be acquired by winning certain rare matches. The goal is to offer a freemium game with lots of customizable elements while making sure that no user can "buy power" with real money. We want everything that a paying user can get to be available to non-paying users who play the game a lot.
      Ultimately we want this to become a competitive game that people can enjoy and really get invested in. Each character is designed with options for counterplay in mind and synergy with other heroes.
       
      We sincerely believe in what this game can become and we home to find someone just as passionate as we are to get involved in this project!
    • By CrazyApplesStudio
         Hello , i would like to showcase my first game project, a simple endless casual arcade game called Apples Mania : Apple Catcher. The game has simple goal , scoring as high as possible by collecting falling apples while the difficulty gradually increases. Different apples are worth different amount of points and there are also 2 power-ups to help you in your challenge.
        The game took me about 2 months to complete and polish and i made everything except for the music tracks and some of the sound files. Made in unity and blender3d.
        Would appreciate any kind of feedback.
      Google Play Link
       
        A trailer showing basic game-play:
       
    • By Paszq
      Troglodytes are a playable races in Arpago - they usually don't talk much and most of them lives near water sources.
    • By Paszq
      a Fox in a dungeon :)
    • By Paszq
      Fox Folk is one of 3 playable races in Arpago.
  • Advertisement
  • Advertisement
Sign in to follow this  

Unity [Unity Asset] Dialog Editor and integrated Speech recognition - feedback requested

This topic is 448 days old which is more than the 365 day threshold we allow for new replies. Please post a new topic.

If you intended to correct an error in the post then please contact us.

Recommended Posts

Hello all,
 
I hereby present to you a package to implement dialogs and speech recognition at the same time!
I've been working on this as part of a graduation project (University of Applied Sciences Rotterdam) and I'd love for you guys to give me some feedback. I hope it'll make speech and dialog implemantations easier for everyone.
 
Feature list:
  • Dialog editor, for normal dialogs or dialogs with user options.
  • Dialogs to implement cutscenes or cutscenes with user options
  • Option to use different grammar files for each dialog (Sphinx 4)
  • Export to Json & Load Json
  • Typewriter animations
  • Delay before a next dialog shows!
  • Out of the box support for 3 speech recognition systems. Google Speech, Wit.ai and Sphinx 4.
  • Automatic selection of dialog answers on speech result. Let's calculate that accuracy!
  • Audio input analyzer. When did the user start talking and when did he stop? Let's cut that audio out, and recognize it!
  • Voice Activation Volume adjuster
  • Callbacks for timers, automatic answer selection and current state of audio input (no audio, listening & analyzing speech)
  • Includes a working Sphinx 4 Server, and text to language model tool. (out of the box support for English, Dutch and German)
  • Automatic grammar files to dictionary to decrease server load
  • Docs available in source and here: https://hespen.net/Portfolio/UnityDialogEditor/annotated.html
 
The project can be found here:
 
 
It contains a Unity Package for easy implementation, the Unity project, a Sphinx 4 Server and a Sphinx 4 Text to Language Model Tool.
 
To make things easier for you to test, I've added keys for the Google Speech API and Wit.ai API. (Wit.ai has an English key, Change the language of Google in the code) Select the speech system you'd like to use on the main camera object
 
I advise you to take a look at Sphinx though. Just import it into your IDE, Gradle Make it, And run the Base object.
 
Remember this is not a finished product, as there still are some bugs in the dialog editor. And I haven't had the time to make it beautifull yet. I did implement this in a VR game, but as that is part of a company, I can't share that one.
 
I'd love to know what you guys think of it!
 
Screenshots:
 
 
 
Demo video (crappy quality, no audio):
 
 
How to use:
Enable Microphone Setup Object and run it and toggle the button for like 5 seconds while being silent. Toggle it off, and speak. When you speak the square should become green. (saved in prefs automatically)
 
Stop the game, disable the microphone setup object. Select the speech system you'd like to use on the Main Camera object. Press enter to start the dialog.
 
Remember: Google en Wit.ai are really slow, use Sphinx 4 for the fastest result! I did research on the implemented speech recognition systems and their accuracy and speed. Sphinx is the fastest with an average of 200ms recognition (external server)! Where Google and Wit.ai will need atleast 2-5 seconds. (tested with 3200 audiofiles, 2 languages)
 
 
The editor:
Windows -> Nodes Editor. Right click to create new nodes or load the json file. Demo Json in Resources folder. Middle click to drag, scroll to zoom. Right click to export to json. You can attach the json to the main camera!
 
  • Keywords are used for speech recognition! They determine the accuracy.
  • Delay in Seconds before dialog is shown
  • Time until next node is a delay before the next node is shown. This one starts counting after the first delay has passed.
 
Last thing: The used google key in this project is attached to a trial account. If I've spend my cash, it won't work anymore. You can however in that case, set up your own trial account for free on the Google website.

Share this post


Link to post
Share on other sites
Advertisement

Sounds interesting, Im dealing myself with the need to implement a dialog editor, but my modest knowledge is not enough. Just a question: why is speech recognition required? I would appreciate much more lip synch.

Share this post


Link to post
Share on other sites

Sounds interesting, Im dealing myself with the need to implement a dialog editor, but my modest knowledge is not enough. Just a question: why is speech recognition required? I would appreciate much more lip synch.

Speech recognition is not required, you can use it without it. But I've been doing research on it for quite some time, and I think it will be used more often in VR worlds. 

If you want to know how the dialog editor is setup, just download the code! I've made sure to heavily comment everything. It's not a finished product yet, but you can learn how it is made (I hope).

 

I'm not quite sure what you mean by "lip synch" though, could you explain that to me a bit further?

Share this post


Link to post
Share on other sites

 

Sounds interesting, Im dealing myself with the need to implement a dialog editor, but my modest knowledge is not enough. Just a question: why is speech recognition required? I would appreciate much more lip synch.

Speech recognition is not required, you can use it without it. But I've been doing research on it for quite some time, and I think it will be used more often in VR worlds. 

If you want to know how the dialog editor is setup, just download the code! I've made sure to heavily comment everything. It's not a finished product yet, but you can learn how it is made (I hope).

 

I'm not quite sure what you mean by "lip synch" though, could you explain that to me a bit further?

 

 

Lip synchronization sinchronizes the lips of the character model with the speech.

Share this post


Link to post
Share on other sites

 

 

Sounds interesting, Im dealing myself with the need to implement a dialog editor, but my modest knowledge is not enough. Just a question: why is speech recognition required? I would appreciate much more lip synch.

Speech recognition is not required, you can use it without it. But I've been doing research on it for quite some time, and I think it will be used more often in VR worlds. 

If you want to know how the dialog editor is setup, just download the code! I've made sure to heavily comment everything. It's not a finished product yet, but you can learn how it is made (I hope).

 

I'm not quite sure what you mean by "lip synch" though, could you explain that to me a bit further?

 

 

Lip synchronization sinchronizes the lips of the character model with the speech.

 

Ok well that is definitely something else. That's not part of the package. That would be part of a Text to Speech solution

Share this post


Link to post
Share on other sites

I'm not quite sure what you mean by "lip synch" though, could you explain that to me a bit further?

 

 

Lip synchronization sinchronizes the lips of the character model with the speech.

 

Ok well that is definitely something else. That's not part of the package. That would be part of a Text to Speech solution

 

 

Well, if Im not too wrong, in a game would be more useful to synchronize prerecorded speech from dubbing actors with model's mouth. I dont think games would be using text to speech anytime soon, at least until voice synthesis improve a lot. Notice Im talking about games here, maybe Text to Speech is a valid solution in other environments.

Share this post


Link to post
Share on other sites
Sign in to follow this  

  • Advertisement