[General] Any linux gurus?

[David]

Sounds like a perfect candidate for a Beowulf cluster to me.  There are 
possibly some gotcha's but you'll have the same problems with just a 
single computer.

Velly intewesting.

Stephan Henning wrote:
> -WD
>
> The GPUs are sent data in chunks that they then process and return. 
> The time it takes a GPU to process a chunk can vary, so I assume the 
> bottle necks we were seeing was when several of the GPU cores would 
> finish at about the same time and request a new chunk and the chunk 
> they needed wasn't already in RAM, so the drive array would take a 
> heavy hit.
>
> Beyond that, I can't really give you a numerical value as to the 
> amount of data they are dumping into the pcie bus.
>
>
> -David
>
> Ya, not sure an FPGA exists large enough for this, it would be 
> interesting though.
>
> While the process isn't entirely sequential, data previously processed 
> is reused in the processing of other data, so that has kept us away 
> from trying a cluster approach.
>
> Depending on the problem, anywhere from minutes per iteration, to 
> weeks per iteration. The weeks long problems are sitting at about 3TB 
> I believe. We've only run benchmark problems on the SSDs up till now, 
> so we haven't had the experience of seeing how they react once they 
> start really getting full.
>
> Sadly, 2TB of RAM would not be enough. I looked into this Dell box 
> (http://www8.hp.com/us/en/products/proliant-servers/product-detail.html?oid=4231377#!tab=features 
> <http://www8.hp.com/us/en/products/proliant-servers/product-detail.html?oid=4231377#%21tab=features>) 
> that would take 4TB, but the costs were insane and it can't support 
> enough GPUs to actually do anything with the RAM...
>
>
>
<<<snip>>>