We've partnered with Pluralsight to bring you even more!
Improve your technical skills with 1,400 Dev / IT courses, included with your Digital-Tutors subscription.
Have you ever thought about building your own home render farm? See how guest author Chris Caufield made his happen.
When Bob Dylan wrote the classic song “The Times They Are a-Changin’”, I don’t think he was thinking about how fast computer technology changes, but it certainly applies to today’s fast-changing times. We can now build a small home render farm in one machine, which is really crazy when you think about it. My purpose for this machine is so I can freelance from home, and be able to live anywhere, while keeping costs to a minimum. Let’s get started!
One of my main considerations was cost. I am starting my own home studio, and the cost of software and other expenses of starting your own business grows every day. An Entertainment Creative Suite license with Maya from Autodesk costs $5,775. Add in the annual subscription and that brings the total over $6,000. With this in mind, I wanted to keep the cost of this machine to less than $3,500.
I could’ve scrambled around and picked up used pieces here and there, and in one case I did, but everything else in this machine will be new. There are other articles out there about scrounging around to find used computers and parts to build a render farm. This blog is about a new machine to handle my rendering needs.
When reviewing processors, we decided to go with AMD. I have built my last few computers using AMD, and really love the cost/reliability factor. We decided to go with dual AMD Opteron 6348, 2.8GHz, 115 watt, 12-core server processors. Twenty-four cores in one machine is just amazing. To do this, we needed to use a server motherboard which is a huge cost by itself, but lessened by the cost of the processors.
Before we go any further, I have to thank my friend, John Vielee. He really knows his way around a motherboard and without his help this would have taken a lot longer!
Here’s a list of the hardware we chose to build this beast:
All of the new hardware was purchased at Amazon, Newegg and Microcenter. Shop around for the best prices, as it changes sometimes from week to week. I decided to put a video card in this machine so that if my main machine were to crash and burn for some reason, I would have a backup ready to go. Keep the clients happy, and no excuses.
I decided to use the GeForce GTX 590 for one reason: It’s just reliable! A gaming card is definitely the way to go these days for a CG machine and, for our purposes, it does a great job handling Maya. You can scrub dynamics no problem, run Viewport 2.0 with DirectX 11, anything. I’ve never had an issue using a GeForce GTX card.
We unpacked everything, put the motherboard on a nice piece of foam from its box to protect it, and started putting everything into the motherboard. Here we have the AMD processors in place, with the RAM installed. We chose low profile RAM so that the Noctua heat sinks would fit over them. Make sure to put the RAM in before the heat sinks.
You can get the RAM in and out after, but it’s a tight fit. We finished this part off by putting the motherboard in the Cooler Master case. The HAF 932 is a huge case, and a bit heavy. But this case will give you a lot of room to work with and when you are using a server motherboard, trust me, you need it.
Next, we put in the Corsair power supply. Pretty straight forward. The great thing about this power supply is that it’s modular, and the flat cable design will really help once we get all the cables in. Another consideration here was the cost to run this machine. An 850 watt power supply isn’t going to kill your electricity bill. After that, we installed the GeForce GTX 590 video card and then the Samsung SSD 840 Pro drive.
Next, we put the four 3TB Red Western Digital drives into the iStar Hot Swap Cage in the front panel of the case for the RAID drives. I felt it was important to have access to the RAID drives and this option worked out great. We set up a RAID 10 on this machine so we’d have our information mirrored across the four drives.
This gives us 6TB of storage with the same 6TB of storage backed up. And by the way, four drives is a minimum you can have in this kind of set up. This left us with a drive bay available for the DVD. All we have to do now is have pizza; it’s lunch time!
Originally we were going to use Windows Server 2012 R2, but when I decided that this may need to be a back-up machine as well, I decided to go with Microsoft Windows 7 Ultimate because you can use up to 192GB of RAM and two CPUs are supported. There are also other aspects of Ultimate that use server features which made Ultimate a good choice for us. Cost is definitely a factor here as well. You may decide to go in a different direction, whatever works for you. Not only is this machine for rendering, but it also could act as a server if I ever have artists working for me.
With this in mind, you’ll need other software to manage all of this. I installed Perforce for file management. This allows you to keep versions of your files on the network. It’s a great tool if you have artists working with you. So one person works on a file at a time and, if they have the file checked out properly, everyone will know who is working on what.
Hansoft is also a good choice for shot assignments. I’ve used this at a few studios and it’s great for tracking shots assignments and for commenting as each artist works on their particular shots.
Finally, we tested the machine on Cinebench to test performance. We tested both CPU and OpenGL. As you can see from the screenshots below, we killed it! We’re in first place in both categories. Run the test on your own machines and see how they compare to this one. I bet you’ll be impressed.
This system was a lot of fun putting this together. We came in under budget at about $3,200, and I wound up using the extra money on more RAM. In the near future, I’ll be building another machine similar to this one, but without the RAID and video card.
Thanks for reading, and I hope this inspired you to build your own render farm!
I’m about to start my life as a freelance artist, Digital Tutors significantly helped me get from occasional hobbyist to a much better artist. After a lot of research and the limited testing I could do, I decided to go the GPU rendering route. I am confident that I get better performance from VRay 3.0 for Maya, once I get my hands on it, than I can from a CPU based renderer. I think it should also provider a higher degree of scalability too.
What are your thoughts? As nVidia are pushing their CUDA support at the moment, maybe now is a good time to look in to it?
Hey Andrew! That’s great! I’m happy hear you’ve been able to improve your life and that we’ve been able to do a small part to assist in that! Thank you!
To answer your question, I think it’s always a good time to look into whether or not you can save time going GPU over CPU. Primarily because it’s always a good time to see if you can save money by doing something a little more efficiently.
Just keep in mind to look at it with an open mind in that it’s not always going to be a reasonable choice for every situation. For example, rendering with the GPU might save you a little bit of time in each render but if it costs you a whole lot more for the setup then you’ll have to weigh how many renders you’re doing and if that little bit of time saved is worth the extra cost. Or would it be cheaper and just as efficient to buy a few extra CPUs to be able to render just as fast with less up front cost?
Since GPU rendering is still relatively new (when compared to CPU rendering), sometimes being on that leading edge of technology isn’t always the best business decision for your freelancing. Anytime you’re dealing with technology it almost always boils down to time vs. money.
I know that’s not an exact answer, but hopefully it gives you some food for thought. Good luck with your freelancing!
Actually, I went with the GPU route because I think it will save money. I have GTX Titan Black and will be getting VRay 3.0 soon and will be hopefully comparing some tests to some high end CPU machines like you described here.
If the difference in IPR speed is anything to go by, it’ll be massive saving. I can let you know what happens, if you’re interested?
You bet! I’d love to hear how it goes!
What and awesome coincidence. I just ordered parts for my render farm last Saturday. Since I don’t have the budget and go with multi-processor server board, I am building the multiple Node farm. Starting with two Nodes each housing 8core AMDs. So I’ll have total of 16 cores for just under $600 in hardware and will add more over time. Hoping to have 40 cores rocking at 3.5ghz by the end of a year. Also, It will be great way to heat up the house on cold winter day :D
I like what you guys are both doing! Not long ago, There are so many ways these days of building high quality, home render machines that suit your needs, Great job!
Speaking of hardware, I have one question for a Tech- Wizard out here (who ever that might be). My PC has 16 gigs of ram and 6 core i7 processor running windows and C4D @64 bit and I have not yet exceed 20 percent of my ram usage during render (usually no more then 3.3gigs) . So i guess my question is.. What is the rule of thumb, on how much ram you need to match the rest of your system?
Good day. The article is very intresting, but I have a question. Why don’t you compare AMD processor with Intel Xeon. I think that will be fair.
I created this build for myself and did not have unlimited funds to build two machines to compare. This build is the result of what I researched and what production I could get for the money on a budget. Xeon’s are too expensive for what we were trying to build.
mmm I would say 5-6 AMD FX-8350 machines would cost about the same and blow this thing away. This looks better suited as a good workstation that you can nicely render on as well. A great build but misleading to call this a cheap renderfarm :P
Would you change anything to make it a super primary “workstation”?
Paul, would 64 cores make this super primary “workstation”?
Because supermicro makes quad CPU version of this mobo and AMD makes 16 core CPU
Daniel L….thanks for the heads up…I just checked out the Quad mobo and the 16 core AMD cpus on new egg…..pretty cool
This is amazing. I have a question though. Can the system take a Corsair Vengeance 8GB (1x8GB) DDR3 1600 MHz as against the (2x4Gig)? and can it take up to 16 diff modules?
First of all thanks for this great post. I, myself have only built my first computer recently, so I understand how you built the computer but there are somethings not mentioned that I would like to know. First is how is this render farm computer connected to your workstation, is it via a router or a switch? Sorry I haven’t networked computers before, so how would you configure the operating system to network?
You’ve also mentioned using RAID, are you using a RAID controller? If yes which RAID controller would you suggest?
Wayne – I am using a NETGEAR 5 Port Gigabit Business-Class Desktop Switch for networking. And the motherboard has a built in RAID controller. A separate RAID controller is expensive, but probably the way to go.
Ceejay C – Thats a great question! Yeah you can use the 8GB, and it does have 16 slots. Just make sure you use the proper OS to get the most memory for your money.
Thanks alot Chris for your reply, it really helps me plan for my next upgrade.
Hello, I want start with 3D on professional level, and I want ask somebody skilled what kind of software can render faster MODO or Maya. Or its depend on hardware configuration? I want make build computer with price 3500dollars, my option: Motherboard MSI BigBang, Intel Xeon 8-core or Core i7 4930K six-core, 32Gb Corsair Dominator 2400MHz CL10, GPU AMD FirePro W7000 or W8000, 2x SSD ADATA 256Gb in Raid0. But I don’t know if I get 110percent of power from this build. Internet is full of discusions about this but everybody says diferent things. So whats important? Better CPU or GPU? I read one where somebody said CPU for high end renders. I don’t know. Whats more important? Clock speed or L3 Cache? How much I get from ECC or bigger clock speed of RAM or CL…. And GPU….I saw some threads more than half saying for Maya Nvidia with Cuda advantage, so if I decided GPU how much VRAM, streamprocessors, better two in SLI and CrossFire? I think FirePro offer better value than Quadro, or take Titan or 780Ti for Maya? I want doing vehicle design, consumer products, all to look realistic. Thanks for response, sorry for my bad English.
Chris, did you connect the two additional +12V 8-pin CPU Power Connectors on the mother board? My Corsair RM850 power supply only came with 1 CPU connector.
You have one 20/24 ATX pin that powers the motherboard (the big long one) and then an EPS for each CPU. so technically for your build you need 3 power cables connecting to the motherboard. Make sure to follow your motherboard and power supply spec sheets for the correct wattage and compatibility.
Update: GeForce GTX 590 crapped out!! Replaced it with a GTX 760. Back in business…..
@Chris, thanks for sharing this killer build! You mentioned you use “Desktop Switch for networking”, so this monster render farm is not your “primary” machine (workstation)? Basically you run routine work on your other machine, and only pass the work to the render farm when needed? If so, do you happen to know any tutorial for creating communication between the workstation and the render farm? Would this render farm overkill for routine work like Word and Photoshop? Many thanks!
I have built mine mostly identical but with a GTX 690 and 32GB ram and 1TB drives rather than the 6’s. I had major issues with the GTX690 not being accepted by the motherboard, but luckily although was a used card was still under warranty so EVGA gave me a replacement. However, even still, my benchmarks aren’t as good as the marks from this blog. So I did some searching and found some things that really helped speed it up. So for those that are using this as your workstation as I am, here’s a few tips I discovered the hard way.
1. MAJOR – Change Windows to High Performance Power settings! If you keep it at balanced…Windows will NOT use all your cores! It PARKS the ones you aren’t using leaving them useless in MAYA!
* I found this app really helps ParkControl
*More about Core Parking The Windows Club – Core Parking
2. MAJOR – Change Batch Render Settings to specify the amount of cores you have by unchecking use all available processors. I noticed that windows will still not use the Parked CPU’s unless you specify the amount.
3. Tell Maya to use your GPU in the Settings!
4. You can also use Open GL for your viewport in Display settings to speed up on screen workflow as well.
* If your batch renders pause or stop, you will need to uncheck batch network settings and maybe even disconnect the internet.
I’m in the same boat as you (worked at big studios but now I’m working freelance from home) but my primary workstation is running Maya on OS X. I’m not much of a hardware guy and have never built a machine myself. I’m wondering this sort of farm machine could be configured to work with OS X or could run a version of OS X as the server OS?
Hey Dave, Thanks for your update. Great tips!!
I am just seeing this, sorry for the delay. Let me ask around. I don’t use OS X but have a few friends who do. Give me a few days and I will see what I can find out…
@Jay – It all depends on how much work you do. Word, overkill. This is more for renders involving 3D objects and applications like Maya, 3DS Max, even After Effects.
I do use it as a render farm and storage for renders, as the build has a RAID. I have only recently worked on this machine for a game project with a studio in Florida.
I haven’t been getting updates, but I corrected that so if anyone else has questions, please feel free.
Again, sorry for the late reponses
HI Chris – based on your results, I just built a similar system using 2 opteron 12 core 2.8 ghz processors (6348). I did get the motherboard that supports 4 processors for future expansion purposes. I have the GTX 980. The problem is I am only getting around 750-950 cb on the cpu cinebench test. Did you overclock your processors? thanks.
scratch my last post. my heatsink was not set right. i am now getting similar speeds on cinebench
Hey SN sorry for the delay, but I am glad you got it working. Are you happy with the results now?? The renders are awesome on my side, hope you’re happy with it!
I am Sunny from India. I have a workstation with the following config. Problem is rendering takes a lot of time, so I am looking to either convert this into a small render farm or setup a new render farm beside it
The hardware is bit outdated as it is from 2011, but even that time it cost me over $ 2.5 K, so if now I use blender for rendering, I would really need to keep the cost of the render farm down but still require a good rendering speed.
Here is the present config:
Intel Core i7 950 3.07 GHz
RAM 12 GB ( If I upgrade the RAM will it help render fast or the rendering speed depends on the processors cores?)
Normal seagate harddisks with external hard disk total 2 TB
Nvidia Quadro 4000 which supports dual monitors. ( Gets over heated to 95 degree when running games or rendering 3D scenes)
Cooler Master Cabinet HF922
Cooler Master silent Pro 750 Watt PSU
Gigabyte Motherboard GA-X58A-UD7
Problem is AMD processors and server boards are not easily available in my city, so I had to go with whatever was available.
Please suggest what should I do: upgrade the current workstation or should I go with another setup just as a render farm and use the current setup for handling software and blender scenes, Quadro is good with handling millions of polygons in view port and billions within VUE software.
What hardware should I use with a medium budget only for rendering in the later case?
It looks like a very good system you put together there. It may be a few years old, but sounds like it runs well. Sometimes when putting together a render farm on a small budget, it is better to get your hands on cheaper, older machines and string them together. The extra processor cores are what will give you more frames rendering at the same time. The machine I built has 24 cores and I set Maya to render a frame on each core. More RAM gives you stronger hardware renders, and lets you have more programs running at the same time.
As far as specific hardware, I can’t recommend anything. I only know what I put together and how that works. I don’t have my hands on any of that other hardware, and couldn’t tell you from experience how good it is.
Do some research and see what works best for you. Some new beefy hardware or a few older, but still strong machines may be the trick. You will figure out what will work best for your needs and budget.
Remember, its all about the art! Maybe budgeting your time in a better way could save you some money as well.
Well it has been one year since you setup the farm, how are the AMD processors working? Have they caused any problems till now ( failure, over heating), especially after rendering for hours?
I have never bought any AMD before. In India Intel rules the processors market. Mine Intel ones working really well even without a liquid cooling fan after 4 years.
I am not sure I will be able to get AMD 12 core processors in my city or not, but I really liked your set-up, rather than this one for blender, which is troublesome to build. https://cgcookie.com/tutorial/setting-up-a-renderfarm/
If I cannot find the opterons ones, using 4 x AMD FX 8320 will suffice for 2 x 12 core processors?
I understand I will have to setup power supply for 4 cpus, though I am not sure how much extra RAM I will be able to add this way.
I know you cannot give a lot of info about different systems but your experience with AMD processors can really help.
Like I said before, my personal experience with AMD has been excellent. Before taking the plunge and buying I would say talk to more people, do more research!
You must be logged in to post a comment. Create a free demo account and be heard.