<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    On 20/11/2011 9:11 PM, Igor Druz wrote:
    <blockquote
cite="mid:CAPEHq69DpySVgiRrh9gMoZZ9WR6Scy5-e3jwwox=wPxLK_bdhw@mail.gmail.com"
      type="cite">
      <div class="gmail_quote">If the -reprod option works fine and we
        can get complete reproducability on one machine, then I would
        think there must be a way&nbsp;of at least minimizing differences&nbsp;on
        two machines.</div>
    </blockquote>
    <br>
    Sure. Make as many things as similar as you can. Just don't bother
    trying too hard. The first tiny difference sees the simulations
    diverge, and you likely cannot prevent such a difference occurring,
    even if the difference is just a different OS on identical hardware.
    Chaos is inescapable here.<br>
    <br>
    <blockquote
cite="mid:CAPEHq69DpySVgiRrh9gMoZZ9WR6Scy5-e3jwwox=wPxLK_bdhw@mail.gmail.com"
      type="cite">
      <div class="gmail_quote">
        &nbsp;</div>
      <div class="gmail_quote">I was hoping to pick on the experience
        with precision, whether it is worth having a go with a double
        precision compilation?</div>
    </blockquote>
    <br>
    That will reduce the effect of differences that affect numerical
    accuracy but make things more than twice as slow.<br>
    <br>
    Mark<br>
    <br>
    <blockquote
cite="mid:CAPEHq69DpySVgiRrh9gMoZZ9WR6Scy5-e3jwwox=wPxLK_bdhw@mail.gmail.com"
      type="cite">
      <div class="gmail_quote">&nbsp;</div>
      <div class="gmail_quote">Igor</div>
      <div class="gmail_quote">&nbsp;</div>
      <div class="gmail_quote">&nbsp;</div>
      <div class="gmail_quote">On Sun, Nov 20, 2011 at 9:16 AM, Mark
        Abraham <span dir="ltr">&lt;<a moz-do-not-send="true"
            href="mailto:Mark.Abraham@anu.edu.au" target="_blank">Mark.Abraham@anu.edu.au</a>&gt;</span>
        wrote:<br>
      </div>
      <blockquote style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex;
        border-left-color: rgb(204, 204, 204); border-left-width: 1px;
        border-left-style: solid;" class="gmail_quote">
        <div bgcolor="#FFFFFF" text="#000000">
          <div> On 20/11/2011 7:31 PM, Igor Druz wrote:
            <blockquote type="cite">
              <div>I recompiled gromacs, lam, fftw3 on both PCs with the
                same version of intel compilers (before they were
                different, v. 10 &amp; 12), set gen_vel=no
                and&nbsp;optimize_fft=no.&nbsp;</div>
              <div>&nbsp;</div>
              <div>With these changes&nbsp;I am getting agreement between two
                PCs within ~5% (was ~20% before). Ignore the nsteps
                value from the pasted mdp file. The actual run with ~20%
                difference was for the 30 ns run. I&nbsp;will&nbsp;test&nbsp;longer
                runs.&nbsp;</div>
              <div>&nbsp;</div>
              <div>Is there anything else to&nbsp;consider for better
                reproducability&nbsp;on two PCs? Hardware is the same, but
                OSes are RedHat and OpenSuse.&nbsp; <br>
              </div>
            </blockquote>
            <br>
          </div>
          So far, you don't even know that the variation attributable to
          the difference in machines is significant compared to the
          intrinsic variation observed over replicates of the same kind
          of simulation on the same machine (e.g. different starting
          velocities). It's just not worth doing the work to study those
          effects...<span><font color="#888888"><br>
              <br>
              Mark</font></span>
          <div>
            <div><br>
              <br>
              <blockquote type="cite">
                <div><br>
                </div>
                <div class="gmail_quote">On Sat, Nov 19, 2011 at 11:31
                  AM, Mark Abraham <span dir="ltr">&lt;<a
                      moz-do-not-send="true"
                      href="mailto:Mark.Abraham@anu.edu.au"
                      target="_blank">Mark.Abraham@anu.edu.au</a>&gt;</span>
                  wrote:<br>
                  <blockquote style="margin: 0px 0px 0px 0.8ex;
                    padding-left: 1ex; border-left-color: rgb(204, 204,
                    204); border-left-width: 1px; border-left-style:
                    solid;" class="gmail_quote">
                    <div bgcolor="#FFFFFF" text="#000000">
                      <div> On 19/11/2011 10:10 PM, Igor Druz wrote:
                        <blockquote type="cite">Hello,
                          <div><br>
                          </div>
                          <div>I am running MDs on a linux PC with
                            OpenSuse, using:</div>
                          <div><br>
                          </div>
                          <div>mpirun -np 4 mdrun -v -dlb auto -reprod
                            ....</div>
                          <div><br>
                          </div>
                          <div>If I repeat the calculation on the same
                            PC, I get the same result. If I change to
                            another PC with RedHat I get a different
                            result.</div>
                        </blockquote>
                        <br>
                      </div>
                      Yep. <a moz-do-not-send="true"
                        href="http://www.gromacs.org/Documentation/Terminology/Reproducibility"
                        target="_blank">http://www.gromacs.org/Documentation/Terminology/Reproducibility</a>
                      <div><br>
                        <br>
                        <blockquote type="cite">
                          <div> More specifically, I am calculating a
                            deviation from experiment, which varies by
                            ~20 % on changing operating systems (pretty
                            much the same hardware on both PCs). Is
                            there any way to avoid such variations? I
                            guess I am missing something in the mdp
                            file, which is: <br>
                          </div>
                        </blockquote>
                        <br>
                      </div>
                      Change your gen_vel seed and I bet you observe a
                      similar variation on the same machine. There are
                      rather few systems that will have equilibrated in
                      2ns, never mind converged.<br>
                      <font color="#888888"> <br>
                        Mark</font>
                      <div>
                        <div><br>
                          <br>
                          <blockquote type="cite">
                            <div><br>
                            </div>
                            <div>
                              <div>cpp &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; = &nbsp;/usr/bin/cpp
                                -traditional</div>
                              <div>integrator &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; = sd</div>
                              <div>tinit &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= 0</div>
                              <div>dt &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; = 0.002</div>
                              <div>nsteps &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; = 1000000</div>
                              <div><br>
                              </div>
                              <div>nstcomm &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= 1</div>
                              <div>nstcalcenergy &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= 1</div>
                              <div>nstxout &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= 5</div>
                              <div>nstvout &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= 100</div>
                              <div>nstlog &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; = 100</div>
                              <div>nstenergy &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= 100</div>
                              <div><br>
                              </div>
                              <div>nstlist &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= &nbsp;5</div>
                              <div>ns_type &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= grid</div>
                              <div><br>
                              </div>
                              <div>pbc &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= xyz</div>
                              <div>rlist &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= 0.9</div>
                              <div><br>
                              </div>
                              <div>optimize_fft &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; = yes</div>
                              <div>coulombtype &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= pme</div>
                              <div>rcoulomb &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; = 0.9</div>
                              <div>epsilon-r &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= 1</div>
                              <div>rvdw &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; = 0.9</div>
                            </div>
                            <div><br>
                            </div>
                            <div>
                              <div>constraints &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= all-bonds</div>
                              <div>constraint-algorithm &nbsp; &nbsp; = Lincs</div>
                              <div><br>
                              </div>
                              <div>unconstrained-start &nbsp; &nbsp; &nbsp;= yes</div>
                              <div>lincs-warnangle &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= 30</div>
                            </div>
                            <div>
                              <div><br>
                              </div>
                              <div>tc_grps &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= System</div>
                              <div>tau_t &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= 0.1</div>
                              <div>ref_t &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= 300.0</div>
                              <div><br>
                              </div>
                              <div>Pcoupl &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; =
                                parrinello-rahman</div>
                              <div>tau_p &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= 2</div>
                              <div>compressibility &nbsp; &nbsp; &nbsp; &nbsp; = 4.5e-05</div>
                              <div>ref_p &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= 1.0</div>
                              <div><br>
                              </div>
                              <div>gen_vel &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= yes</div>
                              <div>gen_temp &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; = 300.0</div>
                              <div>gen_seed &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; = 173529</div>
                              <div><br>
                              </div>
                              <div><br>
                              </div>
                            </div>
                            <div>Many thanks for your help,</div>
                            <div> Igor</div>
                            <br>
                            <fieldset></fieldset>
                            <br>
                          </blockquote>
                          <br>
                        </div>
                      </div>
                    </div>
                    <br>
                    --<br>
                    gmx-users mailing list &nbsp; &nbsp;<a moz-do-not-send="true"
                      href="mailto:gmx-users@gromacs.org"
                      target="_blank">gmx-users@gromacs.org</a><br>
                    <a moz-do-not-send="true"
                      href="http://lists.gromacs.org/mailman/listinfo/gmx-users"
                      target="_blank">http://lists.gromacs.org/mailman/listinfo/gmx-users</a><br>
                    Please search the archive at <a
                      moz-do-not-send="true"
                      href="http://www.gromacs.org/Support/Mailing_Lists/Search"
                      target="_blank">http://www.gromacs.org/Support/Mailing_Lists/Search</a>
                    before posting!<br>
                    Please don't post (un)subscribe requests to the
                    list. Use the<br>
                    www interface or send it to <a
                      moz-do-not-send="true"
                      href="mailto:gmx-users-request@gromacs.org"
                      target="_blank">gmx-users-request@gromacs.org</a>.<br>
                    Can't post? Read <a moz-do-not-send="true"
                      href="http://www.gromacs.org/Support/Mailing_Lists"
                      target="_blank">http://www.gromacs.org/Support/Mailing_Lists</a><br>
                  </blockquote>
                </div>
                <br>
                <br>
                <fieldset></fieldset>
                <br>
              </blockquote>
              <br>
            </div>
          </div>
        </div>
        <br>
        --<br>
        gmx-users mailing list &nbsp; &nbsp;<a moz-do-not-send="true"
          href="mailto:gmx-users@gromacs.org" target="_blank">gmx-users@gromacs.org</a><br>
        <a moz-do-not-send="true"
          href="http://lists.gromacs.org/mailman/listinfo/gmx-users"
          target="_blank">http://lists.gromacs.org/mailman/listinfo/gmx-users</a><br>
        Please search the archive at <a moz-do-not-send="true"
          href="http://www.gromacs.org/Support/Mailing_Lists/Search"
          target="_blank">http://www.gromacs.org/Support/Mailing_Lists/Search</a>
        before posting!<br>
        Please don't post (un)subscribe requests to the list. Use the<br>
        www interface or send it to <a moz-do-not-send="true"
          href="mailto:gmx-users-request@gromacs.org" target="_blank">gmx-users-request@gromacs.org</a>.<br>
        Can't post? Read <a moz-do-not-send="true"
          href="http://www.gromacs.org/Support/Mailing_Lists"
          target="_blank">http://www.gromacs.org/Support/Mailing_Lists</a><br>
      </blockquote>
      <br>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
    </blockquote>
    <br>
  </body>
</html>