<div dir="ltr">Hi,<div><br></div><div>Just to follow up here - we have built smarts into mdrun in 5.1 to refuse to run OpenCL on Mac OS X 10.10.3.</div><div><br></div><div>BTW, we have also enabled support for multiple GPUs per node with OpenCL, but only with thread-MPI (for now).</div><div><br></div><div>Mark</div><br><div class="gmail_quote"><div dir="ltr">On Tue, Jul 21, 2015 at 12:16 AM Erik Lindahl <<a href="mailto:erik.lindahl@gmail.com" target="_blank">erik.lindahl@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word"><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">Hi Carlo,</div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto"><br></div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">I finally had some time to double-check, and my installation indeed passes all regression tests on a Mac Pro with dual AMD Firepro D300 using OS X 10.10.4. Based on the other comments today, this appears to be caused by OS X 10.9 on your machine. Unfortunately OpenCL code is compiled at runtime, and if the error occurs regardless of gcc or clang, it is probably either in the system header files or driver, which means it won’t even help to compile statically on a machine with OS X 10.10.</div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto"><br></div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">Unless anybody has any alternative idea, it sounds as if we’ll have to consider a runtime check to disable OpenCL for AMD on versions prior to 10.10.4.</div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto"><br></div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto"><br></div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">Cheers,</div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto"><br></div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">Erik</div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto"><br></div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto"><br></div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto"><br></div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto"><br></div> <div style="color:black"></div></div><div style="word-wrap:break-word"><div style="color:black"><br>From: <span style="color:black">Carlo Camilloni</span> <a href="mailto:carlo.camilloni@gmail.com" target="_blank"><carlo.camilloni@gmail.com></a><br>Reply: <span style="color:black">Carlo Camilloni</span> <a href="mailto:carlo.camilloni@gmail.com" target="_blank"><carlo.camilloni@gmail.com>></a><br></div></div><div style="word-wrap:break-word"><div style="color:black">Date: <span style="color:black">20 Jul 2015 at 19:50:26</span><br>To: <span style="color:black">Mark Abraham</span> <a href="mailto:mark.j.abraham@gmail.com" target="_blank"><mark.j.abraham@gmail.com>></a><br>Cc: <span style="color:black"><a href="mailto:gmx-developers@gromacs.org" target="_blank">gmx-developers@gromacs.org</a></span> <a href="mailto:gmx-developers@gromacs.org" target="_blank"><gmx-developers@gromacs.org>></a>, <span style="color:black"><a href="mailto:gromacs.org_gmx-developers@maillist.sys.kth.se" target="_blank">gromacs.org_gmx-developers@maillist.sys.kth.se</a></span> <a href="mailto:gromacs.org_gmx-developers@maillist.sys.kth.se" target="_blank"><gromacs.org_gmx-developers@maillist.sys.kth.se>></a>, <span style="color:black">Erik Lindahl</span> <a href="mailto:erik.lindahl@gmail.com" target="_blank"><erik.lindahl@gmail.com>></a></div></div><div style="word-wrap:break-word"><div style="color:black"><br>Subject: <span style="color:black"> Re: [gmx-developers] gromacs 5.1rc1 OpenCL problem with Parrinello-Rahman <br></span></div></div><div style="word-wrap:break-word"><br> <blockquote type="cite"><span><div style="word-wrap:break-word"><div></div><div>
Hi again,
<div><br></div>
<div>I don’t know if you had the opportunity to reproduce
this bug, in the meantime I have compiled it with gcc 4.8, openMP
and sse4.1,</div>
<div>again cpu results are consistently right while OpenCL
results are consistently wrong, so it looks like it is NOT a
problem of Clang 6</div>
<div>but it could be either a problem of the gpu driver or
maybe OpenCL itself, I don’t know..</div>
<div><br></div>
<div>this is the new log</div>
<div><br></div>
<div>
<div style="margin:0px;font-family:Menlo">GROMACS
version: VERSION 5.1-rc1</div>
<div style="margin:0px;font-family:Menlo">
Precision: single</div>
<div style="margin:0px;font-family:Menlo">Memory
model: 64 bit</div>
<div style="margin:0px;font-family:Menlo">MPI
library: thread_mpi</div>
<div style="margin:0px;font-family:Menlo">OpenMP
support: enabled (GMX_OPENMP_MAX_THREADS = 32)</div>
<div style="margin:0px;font-family:Menlo">GPU
support: enabled</div>
<div style="margin:0px;font-family:Menlo">OpenCL
support: enabled</div>
<div style="margin:0px;font-family:Menlo">invsqrt
routine: gmx_software_invsqrt(x)</div>
<div style="margin:0px;font-family:Menlo">SIMD
instructions: SSE4.1</div>
<div style="margin:0px;font-family:Menlo">FFT
library: fftw-3.3.4-sse2-avx</div>
<div style="margin:0px;font-family:Menlo">RDTSCP
usage: enabled</div>
<div style="margin:0px;font-family:Menlo">C++11
compilation: disabled</div>
<div style="margin:0px;font-family:Menlo">TNG
support: enabled</div>
<div style="margin:0px;font-family:Menlo">Tracing
support: disabled</div>
<div style="margin:0px;font-family:Menlo">Built on:
Mon 20 Jul 2015 18:21:43
BST</div>
<div style="margin:0px;font-family:Menlo">Built by:
carlo [CMAKE]</div>
<div style="margin:0px;font-family:Menlo">Build
OS/arch: Darwin 13.4.0 x86_64</div>
<div style="margin:0px;font-family:Menlo">Build CPU
vendor: GenuineIntel</div>
<div style="margin:0px;font-family:Menlo">Build CPU
brand: Intel(R) Xeon(R) CPU E5-1650 v2 @ 3.50GHz</div>
<div style="margin:0px;font-family:Menlo">Build CPU
family: 6 Model: 62 Stepping: 4</div>
<div style="margin:0px;font-family:Menlo">Build CPU
features: aes apic avx clfsh cmov cx8 cx16 f16c htt lahf_lm mmx msr
nonstop_tsc pcid pclmuldq pdcm pdpe1gb popcnt pse rdrnd rdtscp sse2
sse3 sse4.1 sse4.2 ssse3 tdt x2apic</div>
<div style="margin:0px;font-family:Menlo">C compiler:
/opt/local/bin/gcc GNU 4.8.5</div>
<div style="margin:0px;font-family:Menlo">C compiler
flags: -msse4.1 -Wextra
-Wno-missing-field-initializers -Wno-sign-compare -Wpointer-arith
-Wall -Wno-unused -Wunused-value -Wunused-parameter -O3
-DNDEBUG -funroll-all-loops -fexcess-precision=fast
-Wno-array-bounds</div>
<div style="margin:0px;font-family:Menlo">C++
compiler: /opt/local/bin/g++ GNU 4.8.5</div>
<div style="margin:0px;font-family:Menlo">C++ compiler
flags: -msse4.1 -Wextra
-Wno-missing-field-initializers -Wpointer-arith -Wall
-Wno-unused-function -O3 -DNDEBUG -funroll-all-loops
-fexcess-precision=fast -Wno-array-bounds</div>
<div style="margin:0px;font-family:Menlo">Boost
version: 1.58.0 (external)</div>
<div style="margin:0px;font-family:Menlo">OpenCL
include dir: /System/Library/Frameworks/OpenCL.framework</div>
<div style="margin:0px;font-family:Menlo">OpenCL
library:
/System/Library/Frameworks/OPENCL.framework</div>
<div style="margin:0px;font-family:Menlo">OpenCL
version: 1.2</div>
</div>
<div style="margin:0px;font-family:Menlo"><br></div>
<div style="margin:0px;font-family:Menlo"><br></div>
<div>Best,</div>
<div>Carlo</div>
<div><br></div>
<div><br></div>
<div><br>
<div>
<blockquote type="cite">
<div>On 17 Jul 2015, at 13:54, Carlo Camilloni
<<a href="mailto:carlo.camilloni@gmail.com" target="_blank">carlo.camilloni@gmail.com</a>> wrote:</div>
<br>
<div>
<div style="word-wrap:break-word">Hi,
<div><br></div>
<div>Unfortunately on the Mac Pro I am running os x 10.9.5
and the newer clang is not yet available so I cannot test it</div>
<div>with a different version. Erik if you have time to
tell me what to change to get gromacs compiled with gcc I can give
it a try</div>
<div><br></div>
<div>Carlo</div>
<div><br></div>
<div><br></div>
<div>
<div>
<blockquote type="cite">
<div>On 16 Jul 2015, at 20:28, Mark Abraham <<a href="mailto:mark.j.abraham@gmail.com" target="_blank">mark.j.abraham@gmail.com</a>> wrote:</div>
<br>
<div>
<div dir="ltr">Hi,
<div><br></div>
<div>Philip Fowler made a recent positive report on
OpenCL+AMD+Mac and he was using /usr/bin/cc Clang
6.1.0.6020053, so there may be an issue with Clang 6.0 (whatever
real clang version that is...)</div>
<div><br></div>
<div>Mark</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr">On Thu, Jul 16, 2015 at 7:20 PM Erik
Lindahl <<a href="mailto:erik.lindahl@gmail.com" target="_blank">erik.lindahl@gmail.com</a>> wrote:<br></div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">
<div style="font-family:Helvetica,Arial;font-size:13px;margin:0px">Hi,</div>
<div style="font-family:Helvetica,Arial;font-size:13px;margin:0px"><br></div>
<div style="font-family:Helvetica,Arial;font-size:13px;margin:0px">The one obvious difference I can see is that you have
clang 6.0.0, while at least my Macbook pro
says 6.1.0. </div>
<div style="font-family:Helvetica,Arial;font-size:13px;margin:0px"><br></div>
<div style="font-family:Helvetica,Arial;font-size:13px;margin:0px">Could you check if there is any update available for the
developer tools, and if so does that help?</div>
<div style="font-family:Helvetica,Arial;font-size:13px;margin:0px"><br></div>
<div style="font-family:Helvetica,Arial;font-size:13px;margin:0px">It is actually much better to use gcc since you will then
also use all CPU cores. However, that requires patching a header
file in /usr/include; I’ll dig up what I did there - we need to put
it in the documentation anyway.</div>
<div style="font-family:Helvetica,Arial;font-size:13px;margin:0px"><br></div>
<div style="font-family:Helvetica,Arial;font-size:13px;margin:0px">Cheers,</div>
<div style="font-family:Helvetica,Arial;font-size:13px;margin:0px"><br></div>
<div style="font-family:Helvetica,Arial;font-size:13px;margin:0px">Erik</div>
<div></div>
</div>
<div style="word-wrap:break-word">
<div><br>
From: <span>Carlo Camilloni</span> <a href="mailto:carlo.camilloni@gmail.com" target="_blank"><carlo.camilloni@gmail.com></a><br></div>
</div>
<div style="word-wrap:break-word">
<div>Reply: <span>Carlo
Camilloni</span> <a href="mailto:carlo.camilloni@gmail.com" target="_blank"><carlo.camilloni@gmail.com>></a><br>
Date: <span>16 Jul 2015 at
19:07:13</span><br>
To: <span>Erik Lindahl</span> <a href="mailto:erik.lindahl@gmail.com" target="_blank"><erik.lindahl@gmail.com>></a><br>
Cc: <span><a href="mailto:gromacs.org_gmx-developers@maillist.sys.kth.se" target="_blank">gromacs.org_gmx-developers@maillist.sys.kth.se</a></span>
<a href="mailto:gromacs.org_gmx-developers@maillist.sys.kth.se" target="_blank"><gromacs.org_gmx-developers@maillist.sys.kth.se>></a>,
<span><a href="mailto:gmx-developers@gromacs.org" target="_blank">gmx-developers@gromacs.org</a></span>
<a href="mailto:gmx-developers@gromacs.org" target="_blank"><gmx-developers@gromacs.org>></a></div>
</div>
<div style="word-wrap:break-word">
<div><br>
Subject: <span>Re: [gmx-developers] gromacs
5.1rc1 OpenCL problem with Parrinello-Rahman<br></span></div>
</div>
<div style="word-wrap:break-word"><br>
<blockquote type="cite">
<div></div>
<span>Hi Erik,</span>
<div><span><br></span></div>
<div><span>here it is:</span></div>
<div><span><br></span></div>
<div><span><br></span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>GROMACS version: VERSION
5.1-rc1</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>Precision:
single</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>Memory model: 64
bit</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>MPI library:
none</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>OpenMP support: disabled</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>GPU support:
enabled</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>OpenCL support: enabled</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>invsqrt routine:
gmx_software_invsqrt(x)</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>SIMD instructions: AVX_256</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>FFT library:
fftw-3.3.4-sse2-avx</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>RDTSCP usage:
enabled</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>C++11 compilation: disabled</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>TNG support:
enabled</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>Tracing support: disabled</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>Built on: Thu 16
Jul 2015 09:34:14 BST</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>Built by: carlo@
[CMAKE]</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>Build OS/arch: Darwin 13.4.0
x86_64</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>Build CPU vendor: GenuineIntel</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>Build CPU brand: Intel(R) Xeon(R) CPU
E5-1650 v2 @ 3.50GHz</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>Build CPU family: 6 Model: 62
Stepping: 4</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>Build CPU features: aes apic avx clfsh cmov cx8 cx16
f16c htt lahf_lm mmx msr nonstop_tsc pcid pclmuldq pdcm pdpe1gb
popcnt pse rdrnd rdtscp sse2 sse3 sse4.1 sse4.2 ssse3 tdt
x2apic</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>C compiler:
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/cc
Clang 6.0.0.6000057</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>C compiler flags: -mavx
-Wall -Wno-unused -Wunused-value -Wunused-parameter
-Wno-unknown-pragmas -O3 -DNDEBUG</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>C++ compiler:
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/c++
Clang 6.0.0.6000057</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>C++ compiler flags: -mavx -Wextra
-Wno-missing-field-initializers -Wpointer-arith -Wall
-Wno-unused-function -Wno-unknown-pragmas -O3
-DNDEBUG</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>Boost version: 1.58.0
(external)</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>OpenCL include dir:
/System/Library/Frameworks/OpenCL.framework</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>OpenCL library:
/System/Library/Frameworks/OPENCL.framework</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>OpenCL version: 1.2</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo;min-height:14px"><span><br></span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo;min-height:14px"><span><br></span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>Running on 1 node with total 12 logical cores, 2
compatible GPUs</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>Hardware detected:</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span> CPU info:</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span> Vendor: GenuineIntel</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span> Brand: Intel(R) Xeon(R) CPU
E5-1650 v2 @ 3.50GHz</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span> Family: 6 model: 62
stepping: 4</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span> CPU features: aes apic avx clfsh cmov
cx8 cx16 f16c htt lahf_lm mmx msr nonstop_tsc pcid pclmuldq pdcm
pdpe1gb popcnt pse rdrnd rdtscp sse2 sse3 sse4.1 sse4.2 ssse3 tdt
x2apic</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span> SIMD instructions most likely to fit
this hardware: AVX_256</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span> SIMD instructions selected at GROMACS
compile time: AVX_256</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span> GPU info:</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span> Number of GPUs detected:
2</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span> #0: name: AMD Radeon HD - FirePro D500
Compute Engine, vendor: AMD, device version: OpenCL 1.2 , stat:
compatible</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span> #1: name: AMD Radeon HD - FirePro D500
Compute Engine, vendor: AMD, device version: OpenCL 1.2 , stat:
compatible</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span><br></span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span>Carlo</span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span><br></span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span><br></span></div>
<div style="margin:0px;font-size:12px;font-family:Menlo">
<span><br></span></div>
<div><span>On 16 Jul 2015, at 18:59, Erik Lindahl
<<a href="mailto:erik.lindahl@gmail.com" target="_blank">erik.lindahl@gmail.com</a>> wrote:</span></div>
<span><br></span>
<div style="font-family:Helvetica,Arial;font-size:13px;margin:0px"><span>Hi Carlo,</span></div>
<div style="font-family:Helvetica,Arial;font-size:13px;margin:0px"><span><br></span></div>
<div style="font-family:Helvetica,Arial;font-size:13px;margin:0px"><span>IIRC, I managed to get it working on a Mac
Pro with AMD Firepro D300 GPUs. Please post the contents of the top
of your logfile (where it says everything about the compilers &
config), and mention what hardware you tried it on - then we’ll see
if we can reproduce it.</span></div>
<div style="font-family:Helvetica,Arial;font-size:13px;margin:0px"><span><br></span></div>
<div style="font-family:Helvetica,Arial;font-size:13px;margin:0px"><span>Cheers,</span></div>
<div style="font-family:Helvetica,Arial;font-size:13px;margin:0px"><span><br></span></div>
<div style="font-family:Helvetica,Arial;font-size:13px;margin:0px"><span>Erik</span></div>
<span><br>
From: Carlo Camilloni <a href="mailto:carlo.camilloni@gmail.com" target="_blank"><carlo.camilloni@gmail.com></a><br>
Reply: <span><a href="mailto:gmx-developers@gromacs.org" target="_blank">gmx-developers@gromacs.org</a></span> <a href="mailto:gmx-developers@gromacs.org" target="_blank"><gmx-developers@gromacs.org>></a><br>
Date: 16 Jul 2015 at 18:52:21<br>
To: <span><a href="mailto:gromacs.org_gmx-developers@maillist.sys.kth.se" target="_blank">gromacs.org_gmx-developers@maillist.sys.kth.se</a></span>
<a href="mailto:gromacs.org_gmx-developers@maillist.sys.kth.se" target="_blank"><gromacs.org_gmx-developers@maillist.sys.kth.se>></a><br>
Subject: Re: [gmx-developers] gromacs 5.1rc1 OpenCL problem
with Parrinello-Rahman<br>
<br></span>
<div></div>
Hi,<br>
<br>
I tested the OpenCL kernel on my macbook (nvidia gpu) and here it
produces the correct forces,<br>
so it could be a problem related to amd+osx, or maybe to some
specific compiler/os version<br>
<br>
Carlo<br>
<br>
<br>
> On 15 Jul 2015, at 17:42, Carlo Camilloni <<a href="mailto:carlo.camilloni@gmail.com" target="_blank">carlo.camilloni@gmail.com</a>> wrote:<br>
><br>
> Hi,<br>
><br>
> these are the tests that fail:<br>
><br>
> FAILED. Check checkpot.out (12 errors), checkforce.out (3516
errors) file(s) in dd121 for dd121<br>
> FAILED. Check checkpot.out (10 errors), checkforce.out (4027
errors) file(s) in nbnxn-energy-groups for
nbnxn-energy-groups<br>
> FAILED. Check checkpot.out (26 errors), checkforce.out (2998
errors) file(s) in nbnxn-free-energy for
nbnxn-free-energy<br>
> FAILED. Check checkpot.out (26 errors), checkforce.out (2998
errors) file(s) in nbnxn-free-energy-vv for
nbnxn-free-energy-vv<br>
> FAILED. Check checkpot.out (11 errors), checkforce.out (4039
errors) file(s) in nbnxn-ljpme-geometric for
nbnxn-ljpme-geometric<br>
> FAILED. Check checkpot.out (14 errors), checkforce.out (52
errors) file(s) in nbnxn-ljpme-LB for nbnxn-ljpme-LB<br>
> FAILED. Check checkpot.out (14 errors), checkforce.out (52
errors) file(s) in nbnxn-ljpme-LB-geometric for
nbnxn-ljpme-LB-geometric<br>
> FAILED. Check checkpot.out (10 errors), checkforce.out (4029
errors) file(s) in nbnxn-vdw-force-switch for
nbnxn-vdw-force-switch<br>
> FAILED. Check checkpot.out (10 errors), checkforce.out (4032
errors) file(s) in nbnxn-vdw-potential-switch for
nbnxn-vdw-potential-switch<br>
> FAILED. Check checkpot.out (4 errors), checkforce.out (250
errors) file(s) in nbnxn-vdw-potential-switch-argon for
nbnxn-vdw-potential-switch-argon<br>
> FAILED. Check checkpot.out (10 errors), checkforce.out (4027
errors) file(s) in nbnxn_pme for nbnxn_pme<br>
> FAILED. Check checkpot.out (10 errors), checkforce.out (4027
errors) file(s) in nbnxn_pme_order5 for nbnxn_pme_order5<br>
> FAILED. Check checkpot.out (10 errors), checkforce.out (4027
errors) file(s) in nbnxn_pme_order6 for nbnxn_pme_order6<br>
> FAILED. Check checkpot.out (9 errors), checkforce.out (4028
errors) file(s) in nbnxn_rf for nbnxn_rf<br>
> FAILED. Check checkpot.out (2 errors), checkforce.out (4
errors) file(s) in nbnxn_rzero for nbnxn_rzero<br>
> FAILED. Check mdrun.out, md.log file(s) in nbnxn_vsite for
nbnxn_vsite<br>
> FAILED. Check checkpot.out (13 errors), checkforce.out (15512
errors) file(s) in octahedron for octahedron<br>
> FAILED. Check mdrun.out, md.log file(s) in position-restraints
for position-restraints<br>
> FAILED. Check mdrun.out, md.log file(s) in pull_constraint for
pull_constraint<br>
> FAILED. Check checkpot.out (10 errors), checkforce.out (4021
errors) file(s) in pull_cylinder for pull_cylinder<br>
> FAILED. Check checkpot.out (11 errors), checkforce.out (39054
errors) file(s) in swap_x for swap_x<br>
> FAILED. Check checkpot.out (11 errors), checkforce.out (39053
errors) file(s) in swap_y for swap_y<br>
> FAILED. Check checkpot.out (12 errors), checkforce.out (39054
errors) file(s) in swap_z for swap_z<br>
> 23 out of 60 complex tests FAILED<br>
> FAILED. Check mdrun.out, md.log file(s) in expanded for
expanded<br>
> FAILED. Check mdrun.out, md.log file(s) in transformAtoB for
transformAtoB<br>
> 2 out of 10 freeenergy tests FAILED<br>
><br>
><br>
> Carlo<br>
><br>
><br>
>><br>
>><br>
>> Message: 4<br>
>> Date: Wed, 15 Jul 2015 15:35:13 +0000<br>
>> From: Mark Abraham <<a href="mailto:mark.j.abraham@gmail.com" target="_blank">mark.j.abraham@gmail.com</a>><br>
>> To: <a href="mailto:gmx-developers@gromacs.org" target="_blank">gmx-developers@gromacs.org</a>,<br>
>> <a href="mailto:gromacs.org_gmx-developers@maillist.sys.kth.se" target="_blank">gromacs.org_gmx-developers@maillist.sys.kth.se</a><br>
>> Subject: Re: [gmx-developers] gromacs 5.1rc1 OpenCL
problem with<br>
>> Parrinello-Rahman<br>
>> Message-ID:<br>
>> <<a href="mailto:CAMNuMATveVRRyBBwn312xrY+w3M7deC2Hs3A7PZnaeugkw+VVA@mail.gmail.com" target="_blank">CAMNuMATveVRRyBBwn312xrY+w3M7deC2Hs3A7PZnaeugkw+VVA@mail.gmail.com</a>><br>
>> Content-Type: text/plain; charset="utf-8"<br>
>><br>
>> Hi,<br>
>><br>
>> Thanks. If a difference of that magnitude can be seen,
then it should also<br>
>> show up when running the regressiontests (e.g.
cmake<br>
>> -DREGRESSIONTEST_DOWNLOAD=on and then make check) as a
failure<br>
>> of complex/nbnxn-ljpme-LB (which is the only P-R test that
can run on the<br>
>> GPU). If other tests fail, then the problem is actually
more widespread.<br>
>><br>
>> It may be that there is some issue with some part of the
Mac+clang+OpenCL<br>
>> stack - we didn't target it during development, and at the
last minute when<br>
>> Erik was unexpectedly able to get it to compile. I don't
know if he got<br>
>> tests to pass. Erik?<br>
>><br>
>> Mark<br>
>><br>
>> On Wed, Jul 15, 2015 at 5:22 PM Carlo Camilloni
<<a href="mailto:carlo.camilloni@gmail.com" target="_blank">carlo.camilloni@gmail.com</a>><br>
>> wrote:<br>
>><br>
>>><br>
>>> Dear Mark and Szilard,<br>
>>><br>
>>> thanks for your answer. I filed a bug in redmine but
in the meantime I was<br>
>>> running more tests and I am a bit scared by what I
found:<br>
>>><br>
>>> what I have done is the following I have performed a
single step run with<br>
>>> gmx51-rc1 compiled with cuda, again clang and so
on<br>
>>> and compared the forces on the first step with -nb cpu
or not (I am using<br>
>>> -pforce 1), the forces are identical:<br>
>>><br>
>>> ie.:<br>
>>><br>
>>> cuda-gpu<br>
>>><br>
>>> step 0 atom 1 x 3.940 5.612 2.226 force
1.90839e+03<br>
>>> step 0 atom 2 x 3.852 5.659 2.211 force
4.24845e+02<br>
>>> step 0 atom 3 x 3.979 5.665 2.303 force
6.89472e+02<br>
>>> step 0 atom 4 x 3.992 5.610 2.139 force
7.42053e+02<br>
>>><br>
>>><br>
>>> cpu:<br>
>>><br>
>>> step 0 atom 1 x 3.940 5.612 2.226 force
1.90839e+03<br>
>>> step 0 atom 2 x 3.852 5.659 2.211 force
4.24845e+02<br>
>>> step 0 atom 3 x 3.979 5.665 2.303 force
6.89472e+02<br>
>>> step 0 atom 4 x 3.992 5.610 2.139 force
7.42053e+02<br>
>>><br>
>>> if I do the same test on the version compiled with
OpenCL<br>
>>><br>
>>> cpu:<br>
>>><br>
>>> (the former are done on my macbook pro avx2_256 this
latter on a MacPro<br>
>>> avx_256, this should<br>
>>> explain the small differences in the forces)<br>
>>><br>
>>> step 0 atom 1 x 3.940 5.612 2.226 force
1.90838e+03<br>
>>> step 0 atom 2 x 3.852 5.659 2.211 force
4.24848e+02<br>
>>> step 0 atom 3 x 3.979 5.665 2.303 force
6.89470e+02<br>
>>> step 0 atom 4 x 3.992 5.610 2.139 force
7.42043e+02<br>
>>><br>
>>> opencl-gpu:<br>
>>> step 0 atom 1 x 3.940 5.612 2.226 force
1.48597e+03<br>
>>> step 0 atom 2 x 3.852 5.659 2.211 force
6.26942e+02<br>
>>> step 0 atom 3 x 3.979 5.665 2.303 force
8.44032e+02<br>
>>> step 0 atom 4 x 3.992 5.610 2.139 force
7.92786e+02<br>
>>><br>
>>> I am afraid there is something wrong in OpenCL
kernels.<br>
>>><br>
>>> I am using the topol-nvt-nogen.tpr I have uploaded on
redmine.<br>
>>><br>
>>> Best,<br>
>>> Carlo<br>
>>><br>
>>><br>
>>><br>
>>> --<br>
>>> Gromacs Developers mailing list<br>
>>><br>
>>> * Please search the archive at<br>
>>> <a href="http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List" target="_blank">http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List</a>
before<br>
>>> posting!<br>
>>><br>
>>> * Can't post? Read <a href="http://www.gromacs.org/Support/Mailing_Lists" target="_blank">http://www.gromacs.org/Support/Mailing_Lists</a><br>
>>><br>
>>> * For (un)subscribe requests visit<br>
>>> <a href="https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers" target="_blank">https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers</a><br>
>>> or send a mail to <a href="mailto:gmx-developers-request@gromacs.org" target="_blank">gmx-developers-request@gromacs.org</a>.<br>
>>><br>
>> -------------- next part --------------<br>
>> An HTML attachment was scrubbed...<br>
>> URL: <<a href="http://maillist.sys.kth.se/pipermail/gromacs.org_gmx-developers/attachments/20150715/fb1d4126/attachment.html" target="_blank">http://maillist.sys.kth.se/pipermail/gromacs.org_gmx-developers/attachments/20150715/fb1d4126/attachment.html</a>><br>
>><br>
>> ------------------------------<br>
>><br>
>> --<br>
>> Gromacs Developers mailing list<br>
>><br>
>> * Please search the archive at <a href="http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List" target="_blank">http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List</a>
before posting!<br>
>><br>
>> * Can't post? Read <a href="http://www.gromacs.org/Support/Mailing_Lists" target="_blank">http://www.gromacs.org/Support/Mailing_Lists</a><br>
>><br>
>> * For (un)subscribe requests visit<br>
>> <a href="https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers" target="_blank">https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers</a>
or send a mail to <a href="mailto:gmx-developers-request@gromacs.org" target="_blank">gmx-developers-request@gromacs.org</a>.<br>
>><br>
>> End of <a href="http://gromacs.org/" target="_blank">gromacs.org</a>_gmx-developers Digest, Vol 135, Issue
17<br>
>>
***********************************************************<br>
><br>
<br>
--<br>
Gromacs Developers mailing list<br>
<br>
* Please search the archive at <a href="http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List" target="_blank">http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List</a>
before posting!<br>
<br>
* Can't post? Read <a href="http://www.gromacs.org/Support/Mailing_Lists" target="_blank">http://www.gromacs.org/Support/Mailing_Lists</a><br>
<br>
* For (un)subscribe requests visit<br>
<a href="https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers" target="_blank">https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers</a>
or send a mail to <a href="mailto:gmx-developers-request@gromacs.org" target="_blank">gmx-developers-request@gromacs.org</a>.<br>
<div>
<div style="font-family:helvetica,arial;font-size:13px">
-- <br>
<span style="font-family:'helvetica Neue',helvetica">Erik
Lindahl <</span><a href="mailto:erik.lindahl@gmail.com" style="font-family:'helvetica Neue',helvetica" target="_blank">erik.lindahl@gmail.com</a><span style="font-family:'helvetica Neue',helvetica">> </span><br style="font-family:'helvetica Neue',helvetica">
<span style="font-family:'helvetica Neue',helvetica">Professor of Biophysics, Dept. Biochemistry & Biophysics,
Stockholm </span><span style="font-family:'helvetica Neue',helvetica">University </span><br style="font-family:'helvetica Neue',helvetica">
<span style="font-family:'helvetica Neue',helvetica">Professor of Theoretical biophysics, Dept. Theoretical Physics,
Royal Inst. </span><span style="font-family:'helvetica Neue',helvetica">Technology </span><br style="font-family:'helvetica Neue',helvetica">
<span style="font-family:'helvetica Neue',helvetica">Science for Life Laboratory, Box 1031, 17121 Solna,
Sweden</span></div>
</div>
<br></blockquote>
<div>
<div style="font-family:helvetica,arial;font-size:13px">
-- <br>
<span style="font-family:'helvetica Neue',helvetica">Erik
Lindahl <</span><a href="mailto:erik.lindahl@gmail.com" style="font-family:'helvetica Neue',helvetica" target="_blank">erik.lindahl@gmail.com</a><span style="font-family:'helvetica Neue',helvetica">> </span><br style="font-family:'helvetica Neue',helvetica">
<span style="font-family:'helvetica Neue',helvetica">Professor of Biophysics, Dept. Biochemistry & Biophysics,
Stockholm </span><span style="font-family:'helvetica Neue',helvetica">University </span><br style="font-family:'helvetica Neue',helvetica">
<span style="font-family:'helvetica Neue',helvetica">Professor of Theoretical biophysics, Dept. Theoretical Physics,
Royal Inst. </span><span style="font-family:'helvetica Neue',helvetica">Technology </span><br style="font-family:'helvetica Neue',helvetica">
<span style="font-family:'helvetica Neue',helvetica">Science for Life Laboratory, Box 1031, 17121 Solna,
Sweden</span></div>
</div>
</div>
--<br>
Gromacs Developers mailing list<br>
<br>
* Please search the archive at <a href="http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List" rel="noreferrer" target="_blank">http://www.gromacs.org/Support/Mailing_Lists/GMX-developers_List</a>
before posting!<br>
<br>
* Can't post? Read <a href="http://www.gromacs.org/Support/Mailing_Lists" rel="noreferrer" target="_blank">http://www.gromacs.org/Support/Mailing_Lists</a><br>
<br>
* For (un)subscribe requests visit<br>
<a href="https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers" rel="noreferrer" target="_blank">https://maillist.sys.kth.se/mailman/listinfo/gromacs.org_gmx-developers</a>
or send a mail to <a href="mailto:gmx-developers-request@gromacs.org" target="_blank">gmx-developers-request@gromacs.org</a>.</blockquote>
</div>
</div>
</blockquote>
</div>
<br></div>
</div>
</div>
</blockquote>
</div>
<br></div>
</div></div></span></blockquote> <div><div style="font-family:helvetica,arial;font-size:13px">-- <br><span style="font-family:'helvetica Neue',helvetica">Erik Lindahl <</span><a href="mailto:erik.lindahl@gmail.com" style="font-family:'helvetica Neue',helvetica" target="_blank">erik.lindahl@gmail.com</a><span style="font-family:'helvetica Neue',helvetica">> </span><br style="font-family:'helvetica Neue',helvetica"><span style="font-family:'helvetica Neue',helvetica">Professor of Biophysics, Dept. Biochemistry & Biophysics, Stockholm </span><span style="font-family:'helvetica Neue',helvetica">University </span><br style="font-family:'helvetica Neue',helvetica"><span style="font-family:'helvetica Neue',helvetica">Professor of Theoretical biophysics, Dept. Theoretical Physics, Royal Inst. </span><span style="font-family:'helvetica Neue',helvetica">Technology </span><br style="font-family:'helvetica Neue',helvetica"><span style="font-family:'helvetica Neue',helvetica">Science for Life Laboratory, Box 1031, 17121 Solna, Sweden</span></div></div></div></blockquote></div></div>