Optimized Apps for Projects

General News and Banter all users and guests can see this forum.
Forum rules
Welcome to The Scottish Boinc Team boards. See forum rules in pinned post. If you can't be bothered then try not to be too naughty as I have a delete button to press and a ban hammer to swing.
User avatar
Cruncher Pete
Boinc Colonel
Boinc Colonel
Posts: 1569
Joined: Sun Sep 25, 2016 12:32 am
Location: They seek me here, they seek me there, they seek me everywhere.

#1 Optimized Apps for Projects

Unread post by Cruncher Pete » Sat Dec 02, 2017 10:23 pm

There is a New Optimized app for Rakesearch: http://rake.boincfast.ru/rakesearch/for ... .php?id=39
Image

User avatar
Bryan
Boinc Brigadier
Boinc Brigadier
Posts: 2148
Joined: Thu May 21, 2015 6:18 pm

#2 Re: Optimized Apps for Projects

Unread post by Bryan » Fri Jan 25, 2019 8:31 pm

New optimized apps as of 1/13/19 for Acoustics - both Windows and Linux. 2X improvement over the apps the project gives.

The 1st post HERE gives the GitHub link and installation instructions.
Image

User avatar
Hal Bregg
Boinc Sergeant
Boinc Sergeant
Posts: 119
Joined: Thu Nov 08, 2018 1:22 pm
Location: Cumbria

#3 Re: Optimized Apps for Projects

Unread post by Hal Bregg » Fri Jan 25, 2019 10:17 pm

Optimisiation for Acoustics@home works well.

Will we see more projects getting similair updates?
Image

User avatar
Bryan
Boinc Brigadier
Boinc Brigadier
Posts: 2148
Joined: Thu May 21, 2015 6:18 pm

#4 Re: Optimized Apps for Projects

Unread post by Bryan » Fri Jan 25, 2019 10:23 pm

It happens sometimes. Usually it is one of the users that produces them and then after some period of time the project will pick those up as the standard apps.
Image

davidBAM
General Bitchin'
General Bitchin'
Posts: 2395
Joined: Wed Aug 15, 2018 1:15 pm
Location: Huntly, Scotland
Contact:

#5 Re: Optimized Apps for Projects

Unread post by davidBAM » Sat Jan 26, 2019 4:34 am

Thought I might try this on the 2990WX as the plan is to have that purring along for all sprints. Do I need all 5 of these or only the first 4?
  • acoustic_linux64_avx2_v10.tgz
    acoustic_linux64_avx_v10.tgz
    acoustic_linux64_sse2_v10.tgz
    acoustic_linux64_sse41_v10.tgz
  • acoustic_linux64_avx512_v10.tgz
I tried to work this out based on my flags (below) but still figured it was safer to ask :lol: :lol:

flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht sy
scall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl nonstop_tsc cpuid extd_apicid amd_dcm aperfmperf pn
i pclmulqdq monitor ssse3 fma cx16 sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand lahf_lm cmp_legacy svm extapic cr
8_legacy abm sse4a misalignsse 3dnowprefetch osvw skinit wdt tce topoext perfctr_core perfctr_nb bpext perfctr_llc mwaitx
cpb hw_pstate sme ssbd sev ibpb vmmcall fsgsbase bmi1 avx2 smep bmi2 rdseed adx smap clflushopt sha_ni xsaveopt xsavec x
getbv1 xsaves clzero irperf xsaveerptr arat npt lbrv svm_lock nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pa
usefilter pfthreshold avic v_vmsave_vmload vgif overflow_recov succor smca
I think this is fool-proof but could you just try it for me please? • There are 10 types of people in the world; those who understand binary, and those who don’t
Image

User avatar
Bryan
Boinc Brigadier
Boinc Brigadier
Posts: 2148
Joined: Thu May 21, 2015 6:18 pm

#6 Re: Optimized Apps for Projects

Unread post by Bryan » Sat Jan 26, 2019 4:35 am

I played around with the apps tonight. Windows is still 4.5% faster than Linux but a huge improvement. On stock apps Win is 35% faster.

On the 2990WX, running Linux, the AVX2 app is 3X faster than the stock app. It is around 30% faster than SSE4.1 opti app on the 2990WX.

User avatar
Bryan
Boinc Brigadier
Boinc Brigadier
Posts: 2148
Joined: Thu May 21, 2015 6:18 pm

#7 Re: Optimized Apps for Projects

Unread post by Bryan » Sat Jan 26, 2019 4:36 am

You only need the 1st one ... AVX2 for the 2990WX or your Intel machines that support AVX2.

User avatar
Bryan
Boinc Brigadier
Boinc Brigadier
Posts: 2148
Joined: Thu May 21, 2015 6:18 pm

#8 Re: Optimized Apps for Projects

Unread post by Bryan » Sat Jan 26, 2019 4:38 am

Unpack the file and copy the 4 files (that were in the tarball) to your Acoustics project folder. STOP BOINC and then RESTART BOINC and you are good to go. Even if you are already running WU they will finish using the opti app.

davidBAM
General Bitchin'
General Bitchin'
Posts: 2395
Joined: Wed Aug 15, 2018 1:15 pm
Location: Huntly, Scotland
Contact:

#9 Re: Optimized Apps for Projects

Unread post by davidBAM » Sat Jan 26, 2019 4:40 am

Glad I asked - many thanks
I think this is fool-proof but could you just try it for me please? • There are 10 types of people in the world; those who understand binary, and those who don’t
Image

davidBAM
General Bitchin'
General Bitchin'
Posts: 2395
Joined: Wed Aug 15, 2018 1:15 pm
Location: Huntly, Scotland
Contact:

#10 Re: Optimized Apps for Projects

Unread post by davidBAM » Sat Jan 26, 2019 5:20 am

Run time is 25min / 1500secs (give or take a few secs) on 2990WX 3GHz for SSPEMDD v0.18 x86_64-pc-linux-gnu. Temperature stable (yes, I still watch this carefully)

56 pending but 8 computational errors at end of run. Might this be caused by too many jobs finishing at the same time?

User avatar
Bryan
Boinc Brigadier
Boinc Brigadier
Posts: 2148
Joined: Thu May 21, 2015 6:18 pm

#11 Re: Optimized Apps for Projects

Unread post by Bryan » Sat Jan 26, 2019 5:21 am

davidBAM wrote:
Sat Jan 26, 2019 5:20 am

56 pending but 8 computational errors at end of run. Might this be caused by too many jobs finishing at the same time?

Yep! I'm surprised there weren't more than that ... I had 36 my 1st load and then I spread them out and haven't seen anymore errors.

davidBAM
General Bitchin'
General Bitchin'
Posts: 2395
Joined: Wed Aug 15, 2018 1:15 pm
Location: Huntly, Scotland
Contact:

#12 Re: Optimized Apps for Projects

Unread post by davidBAM » Sat Jan 26, 2019 5:23 am

They are a bit naughty with the deadlines they issue on new WU. I make it that some of them have passed the deadline before they get downloaded

User avatar
Bryan
Boinc Brigadier
Boinc Brigadier
Posts: 2148
Joined: Thu May 21, 2015 6:18 pm

#13 Re: Optimized Apps for Projects

Unread post by Bryan » Sat Jan 26, 2019 5:26 am

Are you seeing some WU that are going into panic mode? I have that on a couple of machines but it will correct itself before long. When a new WU starts up BOINC thinks it will take 2 hours to complete and on those machines they take about 30 minutes.

davidBAM
General Bitchin'
General Bitchin'
Posts: 2395
Joined: Wed Aug 15, 2018 1:15 pm
Location: Huntly, Scotland
Contact:

#14 Re: Optimized Apps for Projects

Unread post by davidBAM » Sat Jan 26, 2019 5:29 am

Not sure TBH, I wondered if it was just a way to get run priority from the boinc_client. Mainly I mentioned it to see if it affected bunkering for sprints

davidBAM
General Bitchin'
General Bitchin'
Posts: 2395
Joined: Wed Aug 15, 2018 1:15 pm
Location: Huntly, Scotland
Contact:

#15 Re: Optimized Apps for Projects

Unread post by davidBAM » Sat Jan 26, 2019 5:34 am

So I make that about 150K per day for a 2990WX / 3GHz / Linux on Acoustics

User avatar
Bryan
Boinc Brigadier
Boinc Brigadier
Posts: 2148
Joined: Thu May 21, 2015 6:18 pm

#16 Re: Optimized Apps for Projects

Unread post by Bryan » Sat Jan 26, 2019 5:36 am

If you are using BoincTasks it shows the deadline. There are some projects that will throw out some short deadline WU ... WCG for example. If you are bunkering WCG you need to make sure that all WU you are going to cache have a long enough deadline otherwise they time out while you have the lid on it and the machine becomes "untrusted". When you are ready go to "no new work" and run those shorties and turn them in. They you can put the lid on it.

I didn't see any short Acoustics WU on my machines. What is happening is BOINC doesn't really know how long it will take to finish a WU so it makes a guess. As you complete more and more WU it will figure it out and adjust itself and you will stop going into high-priority mode.

davidBAM
General Bitchin'
General Bitchin'
Posts: 2395
Joined: Wed Aug 15, 2018 1:15 pm
Location: Huntly, Scotland
Contact:

#17 Re: Optimized Apps for Projects

Unread post by davidBAM » Sat Jan 26, 2019 5:39 am

I'll let it finish the WCG backlog and then try a 4 day bunker for Acoustics

User avatar
Bryan
Boinc Brigadier
Boinc Brigadier
Posts: 2148
Joined: Thu May 21, 2015 6:18 pm

#18 Re: Optimized Apps for Projects

Unread post by Bryan » Sat Jan 26, 2019 5:44 am

Go ahead and load up the machine with Acoustics WU. It will give you 1000 and they have a 7 day deadline. That way they will be aged and start validating almost immediately when you get around to them. Right now I'm only at a 41% validation rate. During the last challenge I found that it takes 24-36 hour before pendings stabilize.

davidBAM
General Bitchin'
General Bitchin'
Posts: 2395
Joined: Wed Aug 15, 2018 1:15 pm
Location: Huntly, Scotland
Contact:

#19 Re: Optimized Apps for Projects

Unread post by davidBAM » Sat Jan 26, 2019 2:39 pm

davidBAM wrote:
Sat Jan 26, 2019 5:23 am
They are a bit naughty with the deadlines they issue on new WU. I make it that some of them have passed the deadline before they get downloaded
Total nonsense. I got the date wrong by a week. In mitigation, it was 5am when I formed that opinion :oops:

User avatar
Hal Bregg
Boinc Sergeant
Boinc Sergeant
Posts: 119
Joined: Thu Nov 08, 2018 1:22 pm
Location: Cumbria

#20 Re: Optimized Apps for Projects

Unread post by Hal Bregg » Sat Jan 26, 2019 8:12 pm

What about tweaking amount of WU stored? I read somewhere that if you set those values too hight you might end up in WU not finishing on time.

Speaking of optimalization I went for fastets one based results.

Post Reply Previous topicNext topic

Return to “General”

Who is online

Users browsing this forum: No registered users and 2 guests