Optimized Apps for Projects
Forum rules
Welcome to The Scottish Boinc Team boards. See forum rules in pinned post. If you can't be bothered then try not to be too naughty as I have a delete button to press and a ban hammer to swing.
Welcome to The Scottish Boinc Team boards. See forum rules in pinned post. If you can't be bothered then try not to be too naughty as I have a delete button to press and a ban hammer to swing.
-
- General Bitchin'
- Posts: 6371
- Joined: Wed Aug 15, 2018 1:15 pm
- Location: Huntly, Scotland
- Contact:
#11 Re: Optimized Apps for Projects
They are a bit naughty with the deadlines they issue on new WU. I make it that some of them have passed the deadline before they get downloaded
I think this is fool-proof but could you just try it for me please? • There are 10 types of people in the world; those who understand binary, and those who don’t
#12 Re: Optimized Apps for Projects
Are you seeing some WU that are going into panic mode? I have that on a couple of machines but it will correct itself before long. When a new WU starts up BOINC thinks it will take 2 hours to complete and on those machines they take about 30 minutes.
-
- General Bitchin'
- Posts: 6371
- Joined: Wed Aug 15, 2018 1:15 pm
- Location: Huntly, Scotland
- Contact:
#13 Re: Optimized Apps for Projects
Not sure TBH, I wondered if it was just a way to get run priority from the boinc_client. Mainly I mentioned it to see if it affected bunkering for sprints
I think this is fool-proof but could you just try it for me please? • There are 10 types of people in the world; those who understand binary, and those who don’t
-
- General Bitchin'
- Posts: 6371
- Joined: Wed Aug 15, 2018 1:15 pm
- Location: Huntly, Scotland
- Contact:
#14 Re: Optimized Apps for Projects
So I make that about 150K per day for a 2990WX / 3GHz / Linux on Acoustics
I think this is fool-proof but could you just try it for me please? • There are 10 types of people in the world; those who understand binary, and those who don’t
#15 Re: Optimized Apps for Projects
If you are using BoincTasks it shows the deadline. There are some projects that will throw out some short deadline WU ... WCG for example. If you are bunkering WCG you need to make sure that all WU you are going to cache have a long enough deadline otherwise they time out while you have the lid on it and the machine becomes "untrusted". When you are ready go to "no new work" and run those shorties and turn them in. They you can put the lid on it.
I didn't see any short Acoustics WU on my machines. What is happening is BOINC doesn't really know how long it will take to finish a WU so it makes a guess. As you complete more and more WU it will figure it out and adjust itself and you will stop going into high-priority mode.
I didn't see any short Acoustics WU on my machines. What is happening is BOINC doesn't really know how long it will take to finish a WU so it makes a guess. As you complete more and more WU it will figure it out and adjust itself and you will stop going into high-priority mode.
-
- General Bitchin'
- Posts: 6371
- Joined: Wed Aug 15, 2018 1:15 pm
- Location: Huntly, Scotland
- Contact:
#16 Re: Optimized Apps for Projects
I'll let it finish the WCG backlog and then try a 4 day bunker for Acoustics
I think this is fool-proof but could you just try it for me please? • There are 10 types of people in the world; those who understand binary, and those who don’t
#17 Re: Optimized Apps for Projects
Go ahead and load up the machine with Acoustics WU. It will give you 1000 and they have a 7 day deadline. That way they will be aged and start validating almost immediately when you get around to them. Right now I'm only at a 41% validation rate. During the last challenge I found that it takes 24-36 hour before pendings stabilize.
-
- General Bitchin'
- Posts: 6371
- Joined: Wed Aug 15, 2018 1:15 pm
- Location: Huntly, Scotland
- Contact:
#18 Re: Optimized Apps for Projects
Total nonsense. I got the date wrong by a week. In mitigation, it was 5am when I formed that opinion
I think this is fool-proof but could you just try it for me please? • There are 10 types of people in the world; those who understand binary, and those who don’t
#19 Re: Optimized Apps for Projects
What about tweaking amount of WU stored? I read somewhere that if you set those values too hight you might end up in WU not finishing on time.
Speaking of optimalization I went for fastets one based results.
Speaking of optimalization I went for fastets one based results.
#20 Re: Optimized Apps for Projects
Unless you are bunkered (network communication disabled) then it isn't a problem. If the project sees a WU is past the deadline but it is running on the computer it is okay. Those that go past the deadline and haven't started will get cancelled and removed from your computer by the project.
If you are bunkered and the WU goes beyond the deadline it may or may not get counted and give you credit. When a WU goes past the deadline the project will reissue that to someone else. Most (but not all) projects will give you credit for a late WU if it is turned in before the resend is sent back. There are some projects that will not give you any credit if you are over the deadline.
On projects like Acoustics that have a huge amount of "pendings" it is best to load up as many WU as you can. That way when you start crunching a WU it has "aged" and will and validate sooner.
If you are bunkered and the WU goes beyond the deadline it may or may not get counted and give you credit. When a WU goes past the deadline the project will reissue that to someone else. Most (but not all) projects will give you credit for a late WU if it is turned in before the resend is sent back. There are some projects that will not give you any credit if you are over the deadline.
On projects like Acoustics that have a huge amount of "pendings" it is best to load up as many WU as you can. That way when you start crunching a WU it has "aged" and will and validate sooner.
-
- General Bitchin'
- Posts: 6371
- Joined: Wed Aug 15, 2018 1:15 pm
- Location: Huntly, Scotland
- Contact:
#21 Re: Optimized Apps for Projects
Do you happen to know if these apps will work on a FreeBSD machine? I have a 44 thread Xeon e5 v4 which definitely has AVX2
I think this is fool-proof but could you just try it for me please? • There are 10 types of people in the world; those who understand binary, and those who don’t
-
- General Bitchin'
- Posts: 6371
- Joined: Wed Aug 15, 2018 1:15 pm
- Location: Huntly, Scotland
- Contact:
#22 Re: Optimized Apps for Projects
Looks like it does - there is an ABI in place for Linux compatibility for other projects. I will report once I get some validated WU
I think this is fool-proof but could you just try it for me please? • There are 10 types of people in the world; those who understand binary, and those who don’t
-
- General Bitchin'
- Posts: 6371
- Joined: Wed Aug 15, 2018 1:15 pm
- Location: Huntly, Scotland
- Contact:
#23 Re: Optimized Apps for Projects
E5-2690 v2 Xeons don't have AVX2, is AVX the next-best optimisation to use please? Flags at end of lscpu output
Code: Select all
$ lscpu
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 40
On-line CPU(s) list: 0-39
Thread(s) per core: 2
Core(s) per socket: 10
Socket(s): 2
NUMA node(s): 2
Vendor ID: GenuineIntel
CPU family: 6
Model: 62
Model name: Intel(R) Xeon(R) CPU E5-2690 v2 @ 3.00GHz
Stepping: 4
CPU MHz: 3292.020
CPU max MHz: 3600.0000
CPU min MHz: 1200.0000
BogoMIPS: 5985.49
Virtualisation: VT-x
L1d cache: 32K
L1i cache: 32K
L2 cache: 256K
L3 cache: 25600K
NUMA node0 CPU(s): 0-9,20-29
NUMA node1 CPU(s): 10-19,30-39
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm cpuid_fault epb pti ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts flush_l1d
I think this is fool-proof but could you just try it for me please? • There are 10 types of people in the world; those who understand binary, and those who don’t
#24 Re: Optimized Apps for Projects
Theoretically it should be. However, if the 2690 downclocks when running AVX then the SSE3 might actually be faster.
-
- General Bitchin'
- Posts: 6371
- Joined: Wed Aug 15, 2018 1:15 pm
- Location: Huntly, Scotland
- Contact:
#25 Re: Optimized Apps for Projects
2264 secs on average for first 20 WU with AVX. None have yet validated
I think this is fool-proof but could you just try it for me please? • There are 10 types of people in the world; those who understand binary, and those who don’t
-
- General Bitchin'
- Posts: 6371
- Joined: Wed Aug 15, 2018 1:15 pm
- Location: Huntly, Scotland
- Contact:
#26 Re: Optimized Apps for Projects
Fairly hot for a Xeon but can't say I've ever checked it when running WCG. The temperature difference between the two CPUs is quite normal in a Dell as the exhaust from first CPU fan is intake for the second
Code: Select all
Package id 0: +73.0°C (high = +81.0°C, crit = +95.0°C)
Core 0: +70.0°C (high = +81.0°C, crit = +95.0°C)
Core 1: +69.0°C (high = +81.0°C, crit = +95.0°C)
Core 2: +71.0°C (high = +81.0°C, crit = +95.0°C)
Core 3: +71.0°C (high = +81.0°C, crit = +95.0°C)
Core 4: +73.0°C (high = +81.0°C, crit = +95.0°C)
Core 8: +69.0°C (high = +81.0°C, crit = +95.0°C)
Core 9: +70.0°C (high = +81.0°C, crit = +95.0°C)
Core 10: +70.0°C (high = +81.0°C, crit = +95.0°C)
Core 11: +70.0°C (high = +81.0°C, crit = +95.0°C)
Core 12: +69.0°C (high = +81.0°C, crit = +95.0°C)
Package id 1: +80.0°C (high = +81.0°C, crit = +95.0°C)
Core 0: +80.0°C (high = +81.0°C, crit = +95.0°C)
Core 1: +78.0°C (high = +81.0°C, crit = +95.0°C)
Core 2: +78.0°C (high = +81.0°C, crit = +95.0°C)
Core 3: +80.0°C (high = +81.0°C, crit = +95.0°C)
Core 4: +76.0°C (high = +81.0°C, crit = +95.0°C)
Core 8: +75.0°C (high = +81.0°C, crit = +95.0°C)
Core 9: +80.0°C (high = +81.0°C, crit = +95.0°C)
Core 10: +79.0°C (high = +81.0°C, crit = +95.0°C)
Core 11: +81.0°C (high = +81.0°C, crit = +95.0°C)
Core 12: +78.0°C (high = +81.0°C, crit = +95.0°C)
I think this is fool-proof but could you just try it for me please? • There are 10 types of people in the world; those who understand binary, and those who don’t
#27 Re: Optimized Apps for Projects
The V3 and V4s have AVX2 and they down clock when running AVX2 due to the temperature rise. The V3s have a bug that causes all cores to down clock if any of them are on AVX2. The V4s will only down clock the cores that are running AVX2.