HPCG-Benchmark version=3.1 Release date=March 28, 2019 Machine Summary= Machine Summary::Distributed Processes=720 Machine Summary::Threads per processes=21 Global Problem Dimensions= Global Problem Dimensions::Global nx=10080 Global Problem Dimensions::Global ny=4032 Global Problem Dimensions::Global nz=1344 Processor Dimensions= Processor Dimensions::npx=15 Processor Dimensions::npy=12 Processor Dimensions::npz=4 Local Domain Dimensions= Local Domain Dimensions::nx=672 Local Domain Dimensions::ny=336 Local Domain Dimensions::Lower ipz=0 Local Domain Dimensions::Upper ipz=3 Local Domain Dimensions::nz=336 ########## Problem Summary ##########= Setup Information= Setup Information::Setup Time=0.217935 Linear System Information= Linear System Information::Number of Equations=54623600640 Linear System Information::Number of Nonzero Terms=1502557887916 Multigrid Information= Multigrid Information::Number of coarse grid levels=3 Multigrid Information::Coarse Grids= Multigrid Information::Coarse Grids::Grid Level=1 Multigrid Information::Coarse Grids::Number of Equations=6827950080 Multigrid Information::Coarse Grids::Number of Nonzero Terms=187688123464 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 Multigrid Information::Coarse Grids::Grid Level=2 Multigrid Information::Coarse Grids::Number of Equations=853493760 Multigrid Information::Coarse Grids::Number of Nonzero Terms=23423020984 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 Multigrid Information::Coarse Grids::Grid Level=3 Multigrid Information::Coarse Grids::Number of Equations=106686720 Multigrid Information::Coarse Grids::Number of Nonzero Terms=2938410280 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 ########## Memory Use Summary ##########= Memory Use Information= Memory Use Information::Total memory used for data (Gbytes)=39047.6 Memory Use Information::Memory used for OptimizeProblem data (Gbytes)=0 Memory Use Information::Bytes per equation (Total memory / Number of Equations)=714.848 Memory Use Information::Memory used for linear system and CG (Gbytes)=34364.8 Memory Use Information::Coarse Grids= Memory Use Information::Coarse Grids::Grid Level=1 Memory Use Information::Coarse Grids::Memory used=4105.23 Memory Use Information::Coarse Grids::Grid Level=2 Memory Use Information::Coarse Grids::Memory used=513.36 Memory Use Information::Coarse Grids::Grid Level=3 Memory Use Information::Coarse Grids::Memory used=64.2224 ########## V&V Testing Summary ##########= Spectral Convergence Tests= Spectral Convergence Tests::Result=PASSED Spectral Convergence Tests::Unpreconditioned= Spectral Convergence Tests::Unpreconditioned::Maximum iteration count=9 Spectral Convergence Tests::Unpreconditioned::Expected iteration count=12 Spectral Convergence Tests::Preconditioned= Spectral Convergence Tests::Preconditioned::Maximum iteration count=2 Spectral Convergence Tests::Preconditioned::Expected iteration count=2 Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon= Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Result=PASSED Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Departure for SpMV=1.2711e-15 Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Departure for MG=2.03376e-14 ########## Iterations Summary ##########= Iteration Count Information= Iteration Count Information::Result=PASSED Iteration Count Information::Reference CG iterations per set=50 Iteration Count Information::Optimized CG iterations per set=54 Iteration Count Information::Total number of reference iterations=31750 Iteration Count Information::Total number of optimized iterations=34290 ########## Reproducibility Summary ##########= Reproducibility Information= Reproducibility Information::Result=PASSED Reproducibility Information::Scaled residual mean=0.00499482 Reproducibility Information::Scaled residual variance=0 ########## Performance Summary (times in sec) ##########= Benchmark Time Summary= Benchmark Time Summary::Optimization phase=0.188397 Benchmark Time Summary::DDOT=73.244 Benchmark Time Summary::WAXPBY=88.3826 Benchmark Time Summary::SpMV=311.369 Benchmark Time Summary::MG=1221.26 Benchmark Time Summary::Total=1861.17 Floating Point Operations Summary= Floating Point Operations Summary::Raw DDOT=1.13076e+16 Floating Point Operations Summary::Raw WAXPBY=1.13076e+16 Floating Point Operations Summary::Raw SpMV=1.04954e+17 Floating Point Operations Summary::Raw MG=5.8802e+17 Floating Point Operations Summary::Total=7.15589e+17 Floating Point Operations Summary::Total with convergence overhead=6.62582e+17 GB/s Summary= GB/s Summary::Raw Read B/W=2.36696e+06 GB/s Summary::Raw Write B/W=546859 GB/s Summary::Raw Total B/W=2.91382e+06 GB/s Summary::Total with convergence and optimization phase overhead=2.66109e+06 GFLOP/s Summary= GFLOP/s Summary::Raw DDOT=154383 GFLOP/s Summary::Raw WAXPBY=127940 GFLOP/s Summary::Raw SpMV=337072 GFLOP/s Summary::Raw MG=481485 GFLOP/s Summary::Raw Total=384483 GFLOP/s Summary::Total with convergence overhead=356002 GFLOP/s Summary::Total with convergence and optimization phase overhead=351135 User Optimization Overheads= User Optimization Overheads::Optimization phase time (sec)=0.188397 User Optimization Overheads::Optimization phase time vs reference SpMV+MG time=0.017485 DDOT Timing Variations= DDOT Timing Variations::Min DDOT MPI_Allreduce time=15.7284 DDOT Timing Variations::Max DDOT MPI_Allreduce time=42.7335 DDOT Timing Variations::Avg DDOT MPI_Allreduce time=34.2938 Final Summary= Final Summary::HPCG result is VALID with a GFLOP/s rating of=351135 Final Summary::HPCG 2.4 rating for historical reasons is=353729 Final Summary::Please upload results from the YAML file contents to=http://hpcg-benchmark.org