Return to Question

I am planning to build a very high end deep learning machine with as many Xeon or i7 CPU cores and as many Titan X GPU cards as possible on a single motherboard. So what is the maximum limit for this? Which motherboard will give the maximum leverage without getting saturated?

The single motherboard assumption is to minimize latency keeping in mind the broader goal of extracting maximum performance from the system.

Answers to the comments to make it very specific:

Standard form factor or proprietary?

Standard preferred but not mandatory

Is more GPU sockets or more CPU sockets the priority (eg. would you rather have 2 GPU/4 CPU, or 4 CPU/2 GPU)?

More GPU sockets is the priority.

How important is memory? Do you have a price limit? Do you have a topology requirement?

Not much importance, even 64GB is OK. No price limit. Should not be saturated.

What is required from the hardware:

Run as many CPU intensive individual and possibly containerized applications as possible without getting bottlenecked by memory or topology of the mother board. The motherboard may not be easily available so can also suggest whom to contact to get one. Supermicro seems to offer some solutions .

I am planning to build a very high end deep learning machine with as many Xeon or i7 CPU cores and as many Titan X GPU cards as possible on a single motherboard. So what is the maximum limit for this? Which motherboard will give the maximum leverage without getting saturated?

The single motherboard assumption is to minimize latency keeping in mind the broader goal of extracting maximum performance from the system.

Answers to the comments to make it very specific:

Standard form factor or proprietary?

Standard preferred but not mandatory

Is more GPU sockets or more CPU sockets the priority (eg. would you rather have 2 GPU/4 CPU, or 4 CPU/2 GPU)?

More GPU sockets is the priority.

How important is memory? Do you have a price limit? Do you have a topology requirement?

Not much importance, even 64GB is OK. No price limit. Should not be saturated.

What is required from the hardware:

Run as many CPU and GPU intensive individual and possibly containerized applications as possible without getting bottle-necked by memory or topology of the mother board. The motherboard may not be easily available so can also suggest whom to contact to get one. Supermicro seems to offer some solutions .

I am planning to build a very high end deep learning machine with as many Xeon CPU cores and as many Titan X GPU cards as possible on a single motherboard. So what is the maximum limit for this? Which motherboard will give the maximum leverage without getting saturated?

The single motherboard assumption is to minimize latency keeping in mind the broader goal of extracting maximum performance from the system.

Answers to the comments to make it very specific:

Standard form factor or proprietary?

Standard preferred but not mandatory

Is more GPU sockets or more CPU sockets the priority (eg. would you rather have 2 GPU/4 CPU, or 4 CPU/2 GPU)?

More GPU sockets is the priority.

How important is memory? Do you have a price limit? Do you have a topology requirement?

Not much importance, even 64GB is OK. No price limit. Should not be saturated.

What is required from the hardware:

Run as many CPU intensive individual and possibly containerized applications as possible without getting bottlenecked by memory or topology of the mother board. The motherboard may not be easily available so can also suggest whom to contact to get one.

I am planning to build a very high end deep learning machine with as many Xeon or i7 CPU cores and as many Titan X GPU cards as possible on a single motherboard. So what is the maximum limit for this? Which motherboard will give the maximum leverage without getting saturated?

The single motherboard assumption is to minimize latency keeping in mind the broader goal of extracting maximum performance from the system.

Answers to the comments to make it very specific:

Standard form factor or proprietary?

Standard preferred but not mandatory

Is more GPU sockets or more CPU sockets the priority (eg. would you rather have 2 GPU/4 CPU, or 4 CPU/2 GPU)?

More GPU sockets is the priority.

How important is memory? Do you have a price limit? Do you have a topology requirement?

Not much importance, even 64GB is OK. No price limit. Should not be saturated.

What is required from the hardware:

Run as many CPU intensive individual and possibly containerized applications as possible without getting bottlenecked by memory or topology of the mother board. The motherboard may not be easily available so can also suggest whom to contact to get one. Supermicro seems to offer some solutions .

I am planning to build a very high end deep learning machine with as many Xeon CPU cores and as many Titan X GPU cards as possible on a single motherboard. So what is the maximum limit for this? Which motherboard will give the maximum leverage without getting saturated?

The single motherboard assumption is to minimize latency keeping in mind the broader goal of extracting maximum performance from the system.

Answers to the comments to make it very specific:

Standard form factor or proprietary?

Standard and easily available.

Is more GPU sockets or more CPU sockets the priority (eg. would you rather have 2 GPU/4 CPU, or 4 CPU/2 GPU)?

More GPU sockets is the priority.

How important is memory? Do you have a price limit? Do you have a topology requirement?

Not much importance, even 64GB is OK. No price limit. Should not be saturated.

What is required from the hardware:

Run as many CPU intensive individual and possibly containerized applications as possible without getting bottlenecked by memory or topology of the mother board. The motherboard may not be easily available so can also suggest whom to contact to get one.

I am planning to build a very high end deep learning machine with as many Xeon CPU cores and as many Titan X GPU cards as possible on a single motherboard. So what is the maximum limit for this? Which motherboard will give the maximum leverage without getting saturated?

The single motherboard assumption is to minimize latency keeping in mind the broader goal of extracting maximum performance from the system.

Answers to the comments to make it very specific:

Standard form factor or proprietary?

Standard preferred but not mandatory

Is more GPU sockets or more CPU sockets the priority (eg. would you rather have 2 GPU/4 CPU, or 4 CPU/2 GPU)?

More GPU sockets is the priority.

How important is memory? Do you have a price limit? Do you have a topology requirement?

Not much importance, even 64GB is OK. No price limit. Should not be saturated.

What is required from the hardware:

Run as many CPU intensive individual and possibly containerized applications as possible without getting bottlenecked by memory or topology of the mother board. The motherboard may not be easily available so can also suggest whom to contact to get one.