Changes between Version 19 and Version 20 of u/erica/ScalingBluestreak


Ignore:
Timestamp:
11/04/14 12:10:39 (10 years ago)
Author:
Erica Kaminski
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • u/erica/ScalingBluestreak

    v19 v20  
    33== '''Scaling on Bluestreak''' ==
    44
    5 === Colliding Flows Run - Hydro, Shear Angle 15 ===
    65
    7 * Extremely poor scaling on Bluestreak
    8 
    9 * Memory errors with more nodes (remedied with different hypre library)
    10 
    11 * Delicate balance between speeding up sims with more nodes, and encountering memory issues that kill the sims (remedied with different hypre library)
    12 
    13 || Nodes || Frames || Time to make 1 frame || Notes ||
    14 || 32 || 32-39 || 3 hours || wall-time ran out ||
    15 || 256 || 39-48 || 1 hours || memory died 48.4 ||
    16 || 512 || 48-49 || 1 hours || memory died 49.5 ||
    17 || '''32''' || '''49-50''' || '''4 hours''' || '''walltime ran out''' ||
    18 
    19 [[Image(chart_1.png)]]
    20 
    21 As the number of nodes increases, more patches are made, leading to more ghost zones. Thus, the global info as reported in standard out (that includes physical and ghost zones) increases with nodes.
    22 
    23 [[Image(chart_2.png)]]
    24 
    25 Peak goes down, as the amount of info is distributed over more and more cores.
    26 
    27 [[Image(chart_4.png)]]
    28 
    29 Percent efficiency as given in the standard out.
    30 
    31 
    32 [[Image(chart_3.png)]]
    33 
    34 The time to write to file increases with nodes. This can affect scaling computation (see http://astrobear.pas.rochester.edu/trac/astrobear/wiki/u/erica/ScalingBluestreak for details).
    35 
    36 The memory error is given in 2 places: 1) end of astrobear.log, and 2) a 'core' file that is written to the run directory. I am attaching as an example, the memory error reports for Shear15, nodes 256.
    376
    387
     
    8958The question is, which combination gets me the most frames per hour? With 3 simulations on 512 nodes, the viable options are 1) 1 job with 512 nodes, 2) 2 jobs with 256 n each, 3) 2 jobs @ 128 n, and a 3rd @ 256. Adding up the total frames per hour for the different options shows that option 3) yields the most frames per hour.
    9059
     60== Colliding Flows Run - Hydro, Shear Angle 15 ==
     61
     62* Extremely poor scaling on Bluestreak
     63
     64* Memory errors with more nodes (remedied with different hypre library)
     65
     66* Delicate balance between speeding up sims with more nodes, and encountering memory issues that kill the sims (remedied with different hypre library)
     67
     68|| Nodes || Frames || Time to make 1 frame || Notes ||
     69|| 32 || 32-39 || 3 hours || wall-time ran out ||
     70|| 256 || 39-48 || 1 hours || memory died 48.4 ||
     71|| 512 || 48-49 || 1 hours || memory died 49.5 ||
     72|| '''32''' || '''49-50''' || '''4 hours''' || '''walltime ran out''' ||
     73
     74[[Image(chart_1.png)]]
     75
     76As the number of nodes increases, more patches are made, leading to more ghost zones. Thus, the global info as reported in standard out (that includes physical and ghost zones) increases with nodes.
     77
     78[[Image(chart_2.png)]]
     79
     80Peak goes down, as the amount of info is distributed over more and more cores.
     81
     82[[Image(chart_4.png)]]
     83
     84Percent efficiency as given in the standard out.
     85
     86
     87[[Image(chart_3.png)]]
     88
     89The time to write to file increases with nodes. This can affect scaling computation (see http://astrobear.pas.rochester.edu/trac/astrobear/wiki/u/erica/ScalingBluestreak for details).
     90
     91The memory error is given in 2 places: 1) end of astrobear.log, and 2) a 'core' file that is written to the run directory. I am attaching as an example, the memory error reports for Shear15, nodes 256.