How much am I expected to integrate sound into a game?

Started by
13 comments, last by nsmadsen 11 years, 4 months ago
Say I get a job in a studio as a composer/sound designer and I have a gun sound. It's a first person shooter and it has a cool feature where you are able to find enemies based on where the sound comes from. Now, obviously, the game has to react differently and mix it on the fly so the gunshot will happen on the right vs. the left. This is also true for a waterfall (I would want it to sound like it was behind me if I'm near it) or a deer walking on my right side.

How much are sound designers expected to integrate this sort of thing? As far as the music, are we expected to input the audio into the game itself and mix all of it? What about cues for when music happens? Where does our job stop and the programmer begins? For anything we're expected to do, what kind of tools are there?
Advertisement
As far as I know, I've seen proof that a sound designer guy in Bethesda's Studios had a hand on all the music, all the sound effects and even all the trailers of Skyrim lol

The only thing I know is done separately (besides the OST on some cases) are the recording of voice actors.

Now, engines do come with real time sound effects these days (which is the only way to do realistic sounding stuff unless you use heavily scripted scenes), so I think that the sound processing code is made by programmers while sound engineers/designers are there for tweaking the results (and even then you'd be stepping in a level designer role).

But those are my (un)educated guesses only...

"I AM ZE EMPRAH OPENGL 3.3 THE CORE, I DEMAND FROM THEE ZE SHADERZ AND MATRIXEZ"

My journals: dustArtemis ECS framework and Making a Terrain Generator


As far as the music, are we expected to input the audio into the game itself and mix all of it?

I see sound designer on the level of artists, so your main task is most likely to create/mix sound and music (you don't need to create the base sound yourself or the music) with your common sound tools and to tweak, even integrate, them into the game using provided tools. The tools and engine implementations are most likely done by engine or tool coders.

Back when I was in the game industry our sound designer although coded the sound engine in our game, though we were only a small studio. Therefore for smaller studios, especially indie teams, it could be useful if the sound designer is although able to code, in this case it is kind of a technical artist (a bridge between coder and artist).
Hi dakota--
I'm afraid your question is pretty broad for a forum posting reply, and the answers can vary widely from game to game
Take a look at this video-- it's the introductory talk from GameSoundCon, a conference on game audio that I run. Some of what you're asking is touched on at around the 25-30 minute mark

http://vimeo.com/16516382

We actually have two full days where we try to answer your question, which is why it's hard to digest it down into a couple of paragraphs for a forum reply :)..

Brian Schmidt

Brian Schmidt

Executive Director, GameSoundCon:

GameSoundCon 2016:September 27-28, Los Angeles, CA

Founder, Brian Schmidt Studios, LLC

Music Composition & Sound Design

Audio Technology Consultant

When I was in-house it was part of my job to implement the audio as much as I could with the available tools. At first our toolset was really limited so there wasn't much I could do but later we pulled in FMOD and things really changed. Also our level editor toolset had matured to a point where we could really add some finesse to the audio. Now that I'm freelancing it varies even more. Sometimes I don't even get to implement any of the audio - I just "throw it over the fence" then try to provide as much feedback during testing as possible.

What I've learned over the years is that each team is very different and the toolsets they have differ too. As much as you can, be involved and have you hand in all things audio. I remember with one team things were so back logged that I actually started editing ActionScript in the front end (title screen, menu, character build, etc) myself. I knew the basic play or stop commands in ActionScript and fiddled my way through the code. I'd get a code review and test everything with someone who actually knew coding before checking it back in. Was that technically part of my job? Nope. But I was tired of waiting for simple hook ups to my sounds and just did it anyway. Plus it was kinda fun.

I'm rambling somewhat but my point here is game development is fluid. Sure you have the job description as it relates to HR and such, but once you're hired on - do EVERYTHING you can to make the audio awesome (and early and under budget if at all possible).

Nathan Madsen
Nate (AT) MadsenStudios (DOT) Com
Composer-Sound Designer
Madsen Studios
Austin, TX

Thanks for the responses, guys.

Brian, I don't have time to watch such a large video, but I'll get back to it later tonight when I don't have anything going on. Thank you for that link. I would have loved to go to GameSoundCon, but I live in Florida and game Sound is a very new thing to me.

Nate, what is FMOD? Is it an engine for the audio?

Nate, what is FMOD? Is it an engine for the audio?
[/quote]

Yes, it's a middleware solution for audio. A fantastic program, too! Another option would be Wwise or Xact if you're working with MS projects. Some companies have their own proprietary engines as well.

Thanks,

Nate

Nathan Madsen
Nate (AT) MadsenStudios (DOT) Com
Composer-Sound Designer
Madsen Studios
Austin, TX

Just wanted to add to this a bit. I have a few friends that have work as sound designers in the industry, Sony and EA Games among other studios. Every studio operates differently, but one of my friends, for example, is both sound designer and implementer. He learned the in-house tools as well as 3rd party middleware to both create and design sounds, and implement it into the game. In fact, some of the sounds are done out of house and he just receives them as assets and implements them. They frequently work with the music too. So it's probably about 2-3 guys that are all implementers/light programmers and sound designers, and then the lead audio.

On the other hand, I've had friends that worked just as editors. They're JUST creating assets. They hand it over either to an external studio that does implementation or there's another dude (or dude-ette) in house that does that. It can depend on the flow, if they're working in a new/old engine, how many people are available, budgets, etc etc. Personally I've never worked in-house for a game development studio, only external studios that do audio assets.

But on the real, it's very very common for in-house "Sound Designers" to have implementation and light programming skills.
How much are sound designers expected to integrate this sort of thing?[/quote]

That would depend on how much you want to make yourself more valuable to the industry. :)
If you learn the skills to be able to do that, not only will you be in more demand, but you'll be able to command a higher wage than someone who only creates the sound, expecting that someone else will take care of the integration.

As mentioned, you'll want to make yourself familiar with tools like FMOD, WWise, and more importantly, understand the unique problems and challenges with game audio, so you can see why those tools do what they do.

In general the deeper the skillset you have, the more options you will give yourself going forward.

-Brian

Brian Schmidt

Executive Director, GameSoundCon:

GameSoundCon 2016:September 27-28, Los Angeles, CA

Founder, Brian Schmidt Studios, LLC

Music Composition & Sound Design

Audio Technology Consultant

Such a great thread. I will admit that I would really like to get more into sound design. I'm really not that good, but I definitely want to take the correct steps needed to have a firm foothold on that particular sound aspect.


Quote
How much are sound designers expected to integrate this sort of thing?

That would depend on how much you want to make yourself more valuable to the industry. smile.png
If you learn the skills to be able to do that, not only will you be in more demand, but you'll be able to command a higher wage than someone who only creates the sound, expecting that someone else will take care of the integration.


Great response to a great question. I know that I am one of many who would like to try their hand and imrpove their skill at sound design/implementation. Plus, being in demand ain't half bad either. Are there any things that we can do, as upcoming sound musicians, to gain experience with that kind of thing? I looked up FMOD and had a brain aneurysm when I saw the prices. The closest I have gotten to sound implementation is RPG Maker, which isn't saying much.

My Soundcloud: https://soundcloud.com/jasminecoopermusic

"The moment you cheat for the sake of beauty, you know you are an artist." Max Jacob

This topic is closed to new replies.

Advertisement