[General] Any linux gurus?

[Stephan Henning]

-WD

I believe it's either ext3 or ext4, I'd have to ssh in and check when I get
back on Monday.

-David

I'll check into the Beowulf and see what that would entail. I'll try and
talk with the developer and see what their thoughts are on the feasibility
of running it on a cluster. They may have already gone down this path and
rejected it, but I'll check anyway.


On Thu, Dec 12, 2013 at 6:16 PM, David <ainut at knology.net> wrote:

> Sounds like a perfect candidate for a Beowulf cluster to me.  There are
> possibly some gotcha's but you'll have the same problems with just a single
> computer.
>
> Velly intewesting.
>
> Stephan Henning wrote:
>
>> -WD
>>
>> The GPUs are sent data in chunks that they then process and return. The
>> time it takes a GPU to process a chunk can vary, so I assume the bottle
>> necks we were seeing was when several of the GPU cores would finish at
>> about the same time and request a new chunk and the chunk they needed
>> wasn't already in RAM, so the drive array would take a heavy hit.
>>
>> Beyond that, I can't really give you a numerical value as to the amount
>> of data they are dumping into the pcie bus.
>>
>>
>> -David
>>
>> Ya, not sure an FPGA exists large enough for this, it would be
>> interesting though.
>>
>> While the process isn't entirely sequential, data previously processed is
>> reused in the processing of other data, so that has kept us away from
>> trying a cluster approach.
>>
>> Depending on the problem, anywhere from minutes per iteration, to weeks
>> per iteration. The weeks long problems are sitting at about 3TB I believe.
>> We've only run benchmark problems on the SSDs up till now, so we haven't
>> had the experience of seeing how they react once they start really getting
>> full.
>>
>> Sadly, 2TB of RAM would not be enough. I looked into this Dell box (
>> http://www8.hp.com/us/en/products/proliant-servers/
>> product-detail.html?oid=4231377#!tab=features <http://www8.hp.com/us/en/
>> products/proliant-servers/product-detail.html?oid=4231377#%21tab=features>)
>> that would take 4TB, but the costs were insane and it can't support enough
>> GPUs to actually do anything with the RAM...
>>
>>
>>
>>  <<<snip>>>
>
>
> _______________________________________________
> General mailing list
> General at lists.makerslocal.org
> http://lists.makerslocal.org/mailman/listinfo/general
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.makerslocal.org/pipermail/general/attachments/20131212/a4faf7b2/attachment-0001.html>