Jump to content
  • Advertisement
Sign in to follow this  
agaudreau

Unity To control threads?

This topic is 3454 days old which is more than the 365 day threshold we allow for new replies. Please post a new topic.

If you intended to correct an error in the post then please contact us.

Recommended Posts

Let me start off by saying I am in no way any authority in the industry as I just graduated college and am feeling my way into engine development. I am solely looking to expand my knowledge and possibly help other curious folks. As the hardware industry moves into their newest paradigm of separating cores and adding independent processors so must the software industry adapt to the new technologies. When processors were just getting faster and faster, the easy way to keep games running smoothly was time based programming instead of the frame based ideas that people used to implement. Now the trend is not faster processors but to add more of them, soon I believe we will be witnessing a race of cores between the processor manufacturers. The question is: “How do we design our programs to take advantage of 8, 16, 32, 64, 128+ core processors of the near future?” The answer is: Threading, which allows for parallelism that takes advantage of more cores. I am designing my third game engine from scratch and need to make a critical decision. And the answer is based on the answer to this question: Does running, lets say twenty small threads on one processor core run faster, or better in anyway than evenly distributing the load among five threads on one core? I wrote a tech demo for a dynamically threaded engine to experiment and learn by doing. I know that context switches can be costly and that they happen every time the OS switches threads. Do you (the community) think that it is beneficial to continue perusing a thread manager that spreads the load evenly every so often? Or should I just program everything as a single thread as much as possible in order to skip the overhead of the managing system? If I am missing some important issue or am way off base please tell me. ^^;

Share this post


Link to post
Share on other sites
Advertisement
The more threads per core the lower the performance. Context switches are very expensive. Generally, the approach to systems like PS3 or 360 is to aim for 1 thread per core, with potentially a couple running on the main core (a main thread and a worker thread).

Another challenge with threaded systems is lock/resource contention. Putting 2 objects on separate threads won't necessarily gains you anything performance-wise if they require read/write access to the same memory resource to update successfully. For instance an AI entity will need to know where the player is, but if the player is updating on a separate thread you may have contention over accessing the player's position from the AI entity's thread because the player has that memory locked for update.

Yet another is that in games, there are tons of serially dependent update sequences. For the AI to update it may need to know the results of the physics update or the player input update. So if you have AI and physics in separate threads then you run the risk of updating the AI with last frame's physics results for some objects, and this frame's physics results for others. So depending on the needs of various systems you cannot necessarily parralelize those interdependent sequences.

A common solution to many-core development is a job-based system where you have n worker threads updating a load-balanced set of discreet jobs. This will maximize core usage, but because of the above challenges presents a very difficult problem to solve if you want to apply this to games. To my knowledge no one has found a great solution to this for games, but current attempts generally involve double-buffered shared memory spaces (only updater writes, anyone can read) and a tolerance of operating on out of date information. You will also need to implement a set of barriers so that threads across all relevant cores wait to proceed to step 2 until all threads have completed step 1 (basically managing serial dependencies while trying to do things in parallel that can do so).

It's a giant wasps' nest of hassle. Enjoy the pursuit, it's a fun problem to try and crack.

-me

Share this post


Link to post
Share on other sites
I think I will go ahead and create my thread manager system. At worse performance I assume it would run as fast as a single threaded system right?

I mean, because if every thread is waiting on the currently running thread it only can slow down so much if created and managed correctly.

My manager would initialize based on how many cores the computer is running and swap componants to different threads based on thread performance to keep it as efficiant as possible at any given time.

You are right though, a truely advanced physics system would have to rely on AI and visa~versa. The best performance boosts would be with rendering and things that only need to see values like HUD systems.

I think we need a revolutionary memory design to take full advantage of multi core systems. Something along the lines of allowing multiple cores to access and change the data at the same time or something... but anyway, thank you for the responce.

-TonyG

Share this post


Link to post
Share on other sites
I am not exactly sure what you are getting at. For simple job dispatching systems you can use a threadpool system that will automatically run the thread on an unused or underused core. Otherwise if you are creating long running threads, you generally want to dedicate them to a core and not swap them around.

Share this post


Link to post
Share on other sites
maybe I am going about this wrong but my manager takes in account three types of entitys:

Componant obj (contains stuff for the componant like rendering stuff)
Thread obj (contains vector of componant objs and a system thread)
Core

A componant can run on any thread, with multiple componants on any given thread.
Thread objects are created based on number of cores at startup.

So lets say I have 2 cores therefore 2 threads and I have also 4 componants that are completely independant of each other. The componants would have a value based on how long it takes to run their updates.

the idea would be to evenly distrubute the load like:
thread 1 (comp1: 40%, comp2: 10%)
thread 2 (comp3: 30%, comp4: 20%)

My question was.. would this be faster than just making 4 threads and let the OS take care of it because that would increase context switching but reduce my thread management cost.

Share this post


Link to post
Share on other sites
If you are going to have more threads than cores, it might be in your best interest to let the OS handle it, however, the best practice would be to only create as many threads as cores. Your method only introduces extra overhead.

However, if your threads are following the pattern work->wait->work->wait->work, you might want to reconsider your design and use background workers or some other threadpool implementation. Otherwise, you are simply going to waste time as you are not guaranteed to get any performance by offloading the thread just to collide with the work portion of another thread.

Ideally, if you are going to create a full thread that runs indefinitely, you want it to be something that is going to keep the core busy. As I said, if you are just queing up little jobs, you should look into a threadpool/background worker implementation.

Share this post


Link to post
Share on other sites
Just looked up thread pool. That seems to be what im doing with the exception that I wasnt designing for "tasks" as much as full componants. That might work alot better but will require a redesign of my componants. Thanks for the replies

Share this post


Link to post
Share on other sites
Quote:
Original post by agaudreau
Just looked up thread pool. That seems to be what im doing with the exception that I wasnt designing for "tasks" as much as full componants. That might work alot better but will require a redesign of my componants. Thanks for the replies


If you can break the components into tasks (and this can be often done although it would not seem like it at first), that will allow you to take advantage of the OS's scheduling to reduce collisions and context switching. I am not sure about other implementations, but the .NET threadpool will keep contexts open so a task can slip right in and do its work, without the overhead of creating a new thread context everytime you need work done.

Share this post


Link to post
Share on other sites
Quote:
Original post by agaudreau
You are right though, a truely advanced physics system would have to rely on AI and visa~versa. The best performance boosts would be with rendering and things that only need to see values like HUD systems.


Actually, rendering is the one place where you get no benefit from multiple threads. The GPU is already maximally paralelized and only a single thread can access the device at a time.

Quote:
Original post by agaudreau
I think we need a revolutionary memory design to take full advantage of multi core systems. Something along the lines of allowing multiple cores to access and change the data at the same time or something... but anyway, thank you for the responce.


No, we already have that. That's how shared memory multi-processing works. All threads can concurrently access the memory and that's the problem algorithmically. If two threads are trying to write data to the same class or set of variables they will do it and you'll end up with garbage (some of thread A's bits, some of thread B's. What you aim for with multi-threading is to allow simultaneous reading of memory but prevent simultaneous writing and prevent writing while also reading. And you need to do that while cutting down on lock contention and compare-and-swap operations which get expensive.

But otherwise, what I'd suggest to you after following this thread is for you to take a month or more to research already existing solutions to multi-threaded problems. This isn't even a remotely new field. People have been writing distributed apps for decades, just not games. So study up on the body of algorithms that exist and figure out ways to apply them to your game.

-me

Share this post


Link to post
Share on other sites
Yeah I didn't mean have more than one thread rendering, I was saying the over all system gains from it because one thread can be rendering while another updates sounds or something.

I realize I am not the first to look at this and I also understand that it isnt as easy as it looks at first. I was just wondering about my manager idea.

And also, I meant a new memory system that would bypass the issues when writing and reading at the same time. just more of a musing that anything serious.

Share this post


Link to post
Share on other sites
Sign in to follow this  

  • Advertisement
  • Advertisement
  • Popular Tags

  • Similar Content

    • By Alexander_Vovk
      Hello Guys!
      Please share your experience, where is it better to find sales manager  specialists for indie team of 6 + people(remotely)?
      Maybe someone has a good experience of cooperation with finding projects through sale managers(USA and Canada)?
      Thank you
      Best Regards
      Alex Vovk
      Co-Founder of Sixteen Squares
      Alexander_Vovk@outlook.com
       
    • By RoKabium Games
      Been a bit quiet recently, but we've been busy bug fixing and tweaking things... Now we have lots more 'Particle effects' in the game, specifically here the Flamethrower and Enemy attacks!
    • By JoshuaFraser
      Hi and thanks for reading, I have an issue with this reactive crosshair script, everything works fine until I start changing the offset. Give the script a go and you will see what I mean, when I do SetOffset(0f); it doesnt always set back to the origional state, if anyone can spot a fix I'd be super appreciative!
      using System.Collections; using System.Collections.Generic; using UnityEngine; public class ReactiveCrosshair : MonoBehaviour { [SerializeField] GameObject c_limb_prefab; private float center_offset = 0f; private float current_offset = 0f; private float max_offset = .5f; private int number_of_limbs = 4; private float limb_length = .05f; private float limb_width = .005f; private List<GameObject> c_limbs = new List<GameObject>(); public void SetupCrosshair(){ for (int i = 0; i < number_of_limbs; i++) { GameObject line_go = (GameObject)Instantiate (c_limb_prefab); line_go.transform.SetParent (this.transform); Vector3 limb_pos = new Vector3 (0f,0f,0f); //line_go.transform.position = limb_pos; line_go.transform.localPosition = limb_pos; LineRenderer line = line_go.GetComponent<LineRenderer>(); line.startWidth = limb_width; line.positionCount = 2; line.SetPosition (0, line_go.transform.localPosition + new Vector3(center_offset, 0f, 0f)); line.SetPosition (1, line_go.transform.localPosition + new Vector3(center_offset + limb_length, 0f, 0f)); line.useWorldSpace = false; c_limbs.Add(line_go.gameObject); } if (c_limbs != null) { OrientLimbs (); SetOffset (0f); } } public void OrientLimbs(){ for (int i = 0; i < c_limbs.Count; i++) { float rotation_step = 360f / (float)c_limbs.Count; c_limbs [i].transform.RotateAround (c_limbs[i].transform.position, c_limbs[i].transform.forward, 90f + (rotation_step * (float)i)); } } public void SetOffset(float _current_spread){ float offset = Mathf.Lerp (0f, max_offset, _current_spread); for (int i = 0; i < number_of_limbs; i++) { if (offset > current_offset) { Vector3 pos = c_limbs [i].transform.position + (c_limbs [i].transform.TransformDirection (Vector3.right) * offset); c_limbs [i].transform.position = pos; } if (offset < current_offset) { Vector3 pos = c_limbs [i].transform.position - (c_limbs [i].transform.TransformDirection (Vector3.right) * offset); c_limbs [i].transform.position = pos; } } Debug.Log ("SetOffset() offset: " + offset.ToString () + " _current_spread: " + _current_spread.ToString() + " localPos: " + c_limbs[1].transform.localPosition); current_offset = offset; } }  
    • By Erik Nivala
      So, as the title says i am trying to figure out a good way sync all that information with other players in Unity. My problem is that i can't come up with a good solution since i am used to creating classes for everything e.g. attachments are its own class and then the weapon would save a reference to that attachment. But since you can't send custom classes over [Command] & [ClientRPC] i am a little stuck. A solution for this would be giving each attachment for a slot a unique ID and then passing the ID to other player but i feel like that is very error prone if other ppl add a new attachment or the IDs get mixed up.
      Is there a "standard" way that this is usually done that i am missing?
      I am fairly new to programming so any help is appreciated!
    • By MintyLyton
      I'm looking for any team / people that need a programmer for their project. I'm looking to expand my portfolio which you can see Here. I'm more experienced with Unity but I can spend the time to learn new Engines if that's your preference. I have worked on Unreal Engine 4 before but I might take some time to re-learn it, if the project requires it. Feel free to DM here or use the contact info on my website. 
    • By ethancodes
      I'm working on a system for my game that will allow the player to stack pick ups in a queue. As one pick up expires, the next automatically activates. I'm having an issue though where if I pick up the first one, it activates fine, but if i pick up a second directly after it, it overrides the first one, activates the second one, and then once it has run it's course, everything goes back to normal gameplay, no first pick up. I'm not sure why this is happening. Hopefully someone can spot what I'm doing wrong in my code.
      Here is the code for the pick up manager:
      // Update is called once per frame void Update () { if (pickUpQueue.Count != 0 && !pickUpActive) { pickUpActive = true; pickUpQueue[0].ActivatePickUp(); } DeactivatePickUp(); } void DeactivatePickUp () { if (pickUpQueue.Count != 0 && pickUpActive) { Destroy (pickUpQueue [0]); pickUpQueue.RemoveAt (0); pickUpActive = false; } } And here is the PickUp:
      public override void ActivatePickUp () { ball.GetComponent<Ball>().Speed = 2.0f; //increase ball speed... ball.GetComponent<Ball>().StartCoroutine(timer); //...set time that power up is active }  
      There is also a Base Pick Up:
      public void OnCollisionEnter2D (Collision2D collision) { Vector2 tweak = new Vector2 (Random.Range(0f, 0.2f),Random.Range(0f, 0.2f)); this.gameObject.GetComponent<Rigidbody2D>().velocity += tweak; //if the pickup makes contact with the paddle or ball.... if (collision.gameObject.tag == "Paddle" || collision.gameObject.tag == "Ball") { GameObject.FindObjectOfType<GameManager>().GetComponent<PickUpManager>().pickUpQueue.Add(this); Destroy(gameObject); //...and finally destroy power up object } } As a side note, I am trying to find a solution to this that will work for all of my pickups. Some pickups are ammo based, some are timed. 
    • By D34DPOOL
      Edit Your Profile D34DPOOL 0 Threads 0 Updates 0 Messages Network Mod DB GameFront Sign Out Add jobEdit jobDeleteC# Programmer for a Unity FPS at Anywhere   Programmers located Anywhere.
      Posted by D34DPOOL on May 20th, 2018
      Hello, my name is Mason, and I've been working on a Quake style arena shooter about destroying boxes on and off for about a year now. I have a proof of concept with all of the basic features, but as an artist with little programming skill I've reached the end of my abilities as a programmer haha. I need someone to help fix bugs, optomize code, and to implent new features into the game. As a programmer you will have creative freedom to suggest new features and modes to add into the game if you choose to, I'm usually very open to suggestions :).
      What is required:
      Skill using C#
      Experience with Unity
      Experience using UNET (since it is a multiplayer game), or the effort and ability to learn it
      Compensation:
      Since the game currently has no funding, we can split whatever revenue the game makes in the future. However if you would perfer I can create 2D and/or 3D assets for whatever you need in return for your time and work.
      It's a very open and chill enviornment, where you'll have relative creative freedom. I hope you are interested in joining the team, and have a good day!
       
      To apply email me at mangemason@yahoo.com
    • By davejones
      Is there a way to automatically change the start position of an animation? I have a bunch of animations set up on 3D models in unity. The issue is that I need to move the 3D models, however when I do so the animation start positions are not updated and I have to do it manually.

      Changing the transform of key frames is time consuming with the amount of animations I have, so I was wondering if there was a way to do it automatically?
    • By MoreLion
      hey all! We are looking for members for our Unity horror game! 
      Here’s the story:
      After a deadly virus plunges the world into chaos killing 85% of the human population there are now what they call “zones” these zones are watched very closely by the surviving government, people are checked every day for the virus, even if you touch the spit or any human waste or fluids of the victim who is infected, you will die. But one day, people in the west zone start to go missing, 1 woman goes outside the walls to uncover the mystery, is there more to the virus than meets the eye?, That is where your story starts.
      This game is not a long development game, I have loads other game ideas,
      I will also allow you to have a bit of creative freedom if you wish to add or share a idea!
      And no, it’s not a zombie game lol I feel like zombie games are too generic, in this game you will encounter terrifying beasts!
      There is some concept art one of our concept artists have made
      If interested email liondude12@gmail.com
    • By Canadian Map Makers
      GOVERNOR is a modernized version of the highly popular series of “Caesar” games. Our small team has already developed maps, written specifications, acquired music and performed the historical research needed to create a good base for the programming part of the project.

      Our ultimate goal is to create a world class multi-level strategic city building game, but to start with we would like to create some of the simpler modules to demonstrate proof of concept and graphical elegance.

       

      We would like programmers and graphical artists to come onboard to (initially) create:

      A module where Province wide infrastructure can be built on an interactive 3D map of one of the ancient Roman Provinces.
      A module where city infrastructure can be built on a real 3D interactive landscape.
      For both parts, geographically and historically accurate base maps will be prepared by our team cartographer. Graphics development will be using Blender. The game engine will be Unity.

       

      More information, and examples of the work carried out so far can be found at http://playgovernor.com/ (most of the interesting content is under the Encyclopedia tab).

       

      This project represents a good opportunity for upcoming programmers and 3D modeling artists to develop something for their portfolios in a relatively short time span, working closely with one of Canada’s leading cartographers. There is also the possibility of being involved in this project to the point of a finished game and commercial success! Above all, this is a fun project to work on.

       

      Best regards,

      Steve Chapman (Canadian Map Makers)

       
  • Advertisement
  • Popular Now

  • Forum Statistics

    • Total Topics
      631399
    • Total Posts
      2999854
×

Important Information

By using GameDev.net, you agree to our community Guidelines, Terms of Use, and Privacy Policy.

Participate in the game development conversation and more when you create an account on GameDev.net!

Sign me up!