Search found 46 matches

by noetus
Wed Nov 29, 2017 7:09 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

Thanks for all these comments. The affinity is correct as you described, I had already checked that. As I mentioned before, the core dropout on one NUMA node corresponds to when one batch file is finishing up and the next one is taking over from it. The explanation has to have something to do with t...
by noetus
Wed Nov 29, 2017 5:27 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

The processes are compute-bound. There is very little system resources used while they are active. Disk I/O, Network I/O, and memory use are all low (the system has 32 GB of RAM and each process uses about 100 MB, about 9-10GB of RAM total, divided between the 88 processes). The processes run great ...
by noetus
Wed Nov 29, 2017 3:08 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

This unfortunately made no difference. You still see a cycle of both Numa nodes utilised at 100%, then gradually one of them goes to zero, then it increases back to 100%, then the other decreases to zero, then it goes back to 100%, and so on. I confirmed it this time with the Numa Node view in Task ...
by noetus
Wed Nov 29, 2017 10:26 am
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

So I did some quick and dirty benchmarking. I ran 440 identical processes on a single set of data overall, which each process analysing 1/440 of the data. With hyperthreading on, I had 88 processes running simultaneously, with 5 repetitions of each process (on a different chunk of data each). The to...
by noetus
Wed Nov 29, 2017 8:44 am
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

START /NODE 0 command.bat One of these for each vCore, splitting equally between NODE 0 and NODE 1. The file command.bat then contains a list of commands to run serially. I have been assuming that the commands in the batch file will inherit the NODE setting from the calling START command, but now th...
by noetus
Wed Nov 29, 2017 12:56 am
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

Guys... I have been absent for a while, crunching my own projects. Is there still interest in this topic? I have some weird results. Recall I have an 44 core machine running Windows 10. Each machine has two sockets, each with 22 core Xeon, for a total of 88 threads or virtual cores with HT on. For m...
by noetus
Fri Jul 07, 2017 4:31 am
Forum: Benchmarking and Hardware
Topic: Xeon server build
Replies: 71
Views: 11506

Re: Xeon server build

Mains electricity costs vary in the EU. In US dollars (using Eurostat figures for 2016), in the UK it is 0.20 per kWh, 33% more than what you were basing your calculations on, which is significant. So the payoff for using more recent hardware is considerably more. In Denmark and Germany the price is...
by noetus
Thu Jul 06, 2017 5:14 pm
Forum: Benchmarking and Hardware
Topic: Xeon server build
Replies: 71
Views: 11506

Re: Xeon server build

Does it really make sense to purchase 6 year old server technology? I imagine the cost savings over more recent hardware gets erased within a year or two if running them constantly. Isn't it better to pay this extra cost for more recent hardware that will be more powerful as well as more energy effi...
by noetus
Wed Jul 05, 2017 2:58 am
Forum: Benchmarking and Hardware
Topic: Xeon server build
Replies: 71
Views: 11506

Re: Xeon server build

How about the following 24 core / 48 thread build: Component Model & Source Price (£) Motherboard: ASRock EP2C612D8 Dual Socket 300 CPU: 2 x Intel E5-2648L 1.8GHz 12 Core 270 Memory: 4 x Kingston KVR21R15D8/8 (32 GB) 280 CPU cooler: 2 x Noctua NH-U12DX i4 110 Power supply: Seasonic G450 450W 80+...
by noetus
Wed Jul 05, 2017 1:22 am
Forum: Benchmarking and Hardware
Topic: Xeon server build
Replies: 71
Views: 11506

Re: Xeon server build

That's a great article - it's what got me into these Xeon server builds in the first place! Thanks for posting it.
by noetus
Mon Jul 03, 2017 10:54 am
Forum: Benchmarking and Hardware
Topic: Xeon server build
Replies: 71
Views: 11506

Re: Xeon server build

Entire system. On that budget I am guessing you will go single-socket. I would figure out how much it will cost to buy the system minus the CPU, then see what is left over for the CPU. For example, you might already have a computer case lying around, or other bits and pieces such as a PSU you can p...
by noetus
Sun Jul 02, 2017 3:45 am
Forum: Benchmarking and Hardware
Topic: Xeon server build
Replies: 71
Views: 11506

Re: Xeon server build

pinhodecarlos wrote: Sat Jul 01, 2017 6:59 am My budget is £1,000. What should I get?
For the CPU(s) only, or the entire system?
by noetus
Sun Jul 02, 2017 3:36 am
Forum: Benchmarking and Hardware
Topic: Xeon server build
Replies: 71
Views: 11506

Re: Xeon server build

Now here's the thing, and personally this is what makes it difficult for me to figure out exactly what the best purchase options for the CPU are. Here's a seller selling an E5-4669 v3 QS QH9B . Now this will only clock to 2.4 GHz but it's an 18 core CPU, and slightly cheaper than the 14 core we've b...
by noetus
Sun Jul 02, 2017 3:06 am
Forum: Benchmarking and Hardware
Topic: Xeon server build
Replies: 71
Views: 11506

Re: Xeon server build

I agree that you need to be skeptical and make sure you research the CPUs thoroughly. I mis-stated the max turbo on all cores but only a little but. It's actually only 3Ghz. While researching I found more than one post with HWinfo pics of a QHV5 with all cores clocking at 3.0. Here's one forum post...
by noetus
Fri Jun 30, 2017 2:16 pm
Forum: Benchmarking and Hardware
Topic: Xeon server build
Replies: 71
Views: 11506

Re: Xeon server build

I would like to butt in here, as since last Sept I've been aquiring both ES and non-ES E5 v3 and v4 Xeons for various system builds. I'm by no means experienced in this, but I have built up a bit of experience in purchasing and trying out several of these. All together 10 xeons purchased, 2 sent bac...
by noetus
Wed Jun 28, 2017 9:17 am
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

OK, so I now have the 44 core / 88 thread machine up and running, and it is full of lovely scrumptious goodness. I was easily able to run at full 100% utilisation on each core (for 4 hours continuously) with my own crunching project, starting 88 separate threads from the command line. It also seems ...
by noetus
Fri Jun 09, 2017 1:05 am
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

OK, this is along the lines of what I assumed. Regarding single-threaded command line applications; multiple instances of these will also be assigned NUMA nodes according to best practices for efficiency I assume.
by noetus
Thu Jun 08, 2017 12:57 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

Let me see if I'm reading you right. So you're saying if I take a 44 core / 88 thread machine, and limit it to 32 cores / 64 threads in BIOS, then run Cinebench on Windows, then enable all cores in BIOS, and run Cinebench again, I won't see any significant difference in the benchmark scores?
by noetus
Wed Jun 07, 2017 10:42 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

A point of clarification: was the earlier claim of a limit of 64 threads (by Bryan) related to Boinc specifically or was it supposed to cover any set of processes one might care to run? In my own coding I do not code multi-threaded apps. I tried that and it didn't work out well (thread management wa...
by noetus
Wed Jun 07, 2017 10:28 pm
Forum: World Community Grid
Topic: WCG team position
Replies: 340
Views: 99704

Re: WCG team position

Two quick little questions. First, why is the rank stated as 156 on boincstats.com but 158 on WCG's own rank list?

Second, what is the difference between points generated and points returned on WCG?
by noetus
Tue Jun 06, 2017 1:56 pm
Forum: Milestones
Topic: Recent Milestones
Replies: 26
Views: 15430

Re: Recent Milestones

Sorry to be thick, but how are milestones calculated? The WCG homepage shows I've crunched 1,415,613 points for TSBT (as of just now).
by noetus
Fri Jun 02, 2017 9:35 am
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

"On Windows there are only 64 NUMA channels - period. It doesn't matter how many threads the CPU's have because they will be sharing the 64 NUMA pipes. If you run more than 64 threads simultaneously it will start "sharing" the memory pipes. That means that it has to load the memory pi...
by noetus
Thu Jun 01, 2017 1:37 pm
Forum: Milestones
Topic: Recent Milestones
Replies: 26
Views: 15430

Re: Recent Milestones

So all the World Community Grid projects are lumped together? I was surprised to see SBT's contribution to WCG is very variable - goes up and down a lot. Was down a lot then went up really a lot towards the end of May. And it seems only quite a small fraction of SBT member's points go to WCG. Most p...
by noetus
Wed May 31, 2017 10:08 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

And the upcoming Xeon Platinum 8180 with 28 cores. That's 112 threads on a dual processor motherboard.

Windows 10 supports up to 256 cores (512 threads with hyperthreading), so we don't have anything to worry about for the time being...
by noetus
Wed May 31, 2017 8:07 am
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

OK, not all smooth. Since installing the new client each machine now has two entries in my device management page on the WCG portal. Seeems like maybe the new client didn't recognise the machine and set a new machine ID or something? Bizarrely, though, it didn't do this for every machine - one of th...
by noetus
Wed May 31, 2017 8:02 am
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

My machines aren't dedicated to the project. I only donate spare CPU cycles. The BOINC processes are all set to idle priority and don't interfere with my day-to-day work at all. Don't notice a thing, even at 100% CPU usage, so I'm fine with that. And as mentioned earlier, I solved the ramping up and...
by noetus
Tue May 30, 2017 10:24 pm
Forum: Welcome
Topic: Welcome to noetus
Replies: 8
Views: 2039

Re: Welcome to noetus

So many worthy ones it' s hard to choose between them!
by noetus
Tue May 30, 2017 4:04 pm
Forum: Website Problems
Topic: No Country for Scotland?
Replies: 2
Views: 1171

No Country for Scotland?

I would like to see Scotland (and Wales, England,N.I. etc) listed as separate countries, which they are, on the World Community Grid country lists. Currently the UK is listed as a country. This is like lumping France, Germany, Spain, Italy and all the rest under a single "country" called t...
by noetus
Tue May 30, 2017 3:18 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

Restared machine and client, everything good now!

Thanks for all the other info!
by noetus
Tue May 30, 2017 2:57 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

Oh, don't worry about CPU cooling in my case - I make sure to have excellent cooling. When running my own cpu intensive tasks I have been having these machines sitting at 100% for weeks at a time, temps never go out of the 50s. Built the systems myself from scratch, too. I figured out the whiplashin...
by noetus
Tue May 30, 2017 2:37 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

Thanks for that info. Seems like the client hosted by WCG is a fork of IBM's. Can confirm that I now have 56 threads. However a different issue has surfaced, which is that CPU usage is jumping around all over the place. Seems like the client keeps on throttling back (which it wasn't before). Is ther...
by noetus
Tue May 30, 2017 2:18 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

OK, so this is a completely different client - different look, and I'm assuming different menu structure, which is why your directions to find the "Event Log" did not work in my case. Also provides connection to a much wider variety of Projects - there is more out there than provided by Wo...
by noetus
Tue May 30, 2017 2:00 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

Download link is on top right. The file name is wcg_boinc_7.2.47_windows_intelx86, and the file is dated 27-05-2017 16:26 CET, which is when I downloaded it. So indeed it was the 32 bit version, hosted by WCG. Pretty weird. Apologies for blaming you good people for not figuring this out earlier - se...
by noetus
Tue May 30, 2017 1:56 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

Yeah, I figured out that the non Virtual Box version can be downloaded here: http://boinc.berkeley.edu/download.php And I also figured out that I need to do a clean install, because it installed in 32 bit location last time. I downloaded the earlier version from: https://www.worldcommunitygrid.org/v...
by noetus
Tue May 30, 2017 1:47 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

Testing this now. You might want to put this as a sticky somewhere obvious. My issue - 32 threads only - was right there in the topic title, and it took all this time to figure out it is a known/documented issue.
by noetus
Tue May 30, 2017 1:44 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

Why did the 'Download' button on the world community thread website give me an out of date client?
by noetus
Tue May 30, 2017 1:36 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

And in case you are in doubt that I hit my funny bone and installed Win 8.1 when I thought I was installing Win 10 Enterprise, here's a screenshot of of HWiNFO64 too: https://ibb.co/ffLbna Like I said, this whole thing is giving me a headache. For something that is supposed to be easy to install and...
by noetus
Tue May 30, 2017 1:30 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

There is no "Event Log" under "Tools". There is only, in advanced view, "Add project or account manager...", "Options...", "Computing preferences..." (When in Simple View there is only "Computing preferences..." and "Options...", ...
by noetus
Tue May 30, 2017 1:11 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

Is there a way of posting screenshots on this forum without using an image hoster? Save the image to a file, click the "Attachments" tab at the bottom of the post dialog, click "Add files", select your image file, click "Place inline", make sure attachment tag is place...
by noetus
Tue May 30, 2017 1:06 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

cc_config.xml doesn't seem to have anything useful: <cc_config> <log_flags> </log_flags> <options> <client_download_url>http://www.worldcommunitygrid.org/reg/ms/viewDownloadAgain.do</client_download_url> <client_version_check_url>http://www.worldcommunitygrid.org/download_all.php?xml=1</client_versi...
by noetus
Tue May 30, 2017 12:36 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

Nope, as I mentioned earlier with my own projects (.NET) I can run 56 threads no problem, and it is definitely the 64 bit version of the OS that is installed! 8-) By the way, I also mentioned each system has 32 GB RAM. Since when does a 32 bit OS address 32 GB of RAM? PS. Name of process: wcgrid_scc...
by noetus
Tue May 30, 2017 12:19 pm
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

I checked the system memory and settings. Each system has 32 GB RAM, and client is allowed to use 50% of it (75% when idle). Since each WU is using about 40 MB of RAM, that is a total RAM usage right now of 32 x 40 = 1280 MB, which is less than 4% of system RAM, so I don't think RAM is the issue.
by noetus
Tue May 30, 2017 11:29 am
Forum: Welcome
Topic: Welcome to noetus
Replies: 8
Views: 2039

Re: Welcome to noetus

Thanks for the welcome! There were two reasons I joined this team. First is that I grew up and went to school on the Isle of Skye and though I've been living abroad for most of my adult life (currently in France; from Sept in Budapest) I still feel a pretty strong connection to Scotland. Second I wa...
by noetus
Tue May 30, 2017 11:12 am
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

And to answer the other questions: username is same as here on the forums, and project is Smash Childhood Cancer. Yeah, and despite my self-affirmed "tech savvy" nature I got the number of threads wrong on my original post - indeed it is 56 and not 52.
by noetus
Tue May 30, 2017 11:07 am
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Re: Xeon - not utilising more than 32 threads

Oh guys, thanks for all the responses! I'm overwhelmed - never thought that I would see so much activity in response to my question. Thanks also for the welcome to the Team. I am going to respond to that thread as well to tell you all a little bit about myself (in case anyone's interested). You can ...
by noetus
Tue May 30, 2017 3:21 am
Forum: Benchmarking and Hardware
Topic: Xeon - not utilising more than 32 threads
Replies: 76
Views: 13844

Xeon - not utilising more than 32 threads

Hi, I'm new to BOINC and to this forum, having just joined this team! I have two Xeon builds with 52 threads each. BOINC only runs 32 threads, so it only utilises a max of 57% of available CPU. I've tried changing the local setting to 100% of CPU, and I've tried increasing the number of CPU cores to...

Go to advanced search