HPCG-Benchmark version=3.1 Release date=March 28, 2019 Machine Summary= Machine Summary::Distributed Processes=123648 Machine Summary::Threads per processes=1 Global Problem Dimensions= Global Problem Dimensions::Global nx=7168 Global Problem Dimensions::Global ny=6144 Global Problem Dimensions::Global nz=5888 Processor Dimensions= Processor Dimensions::npx=56 Processor Dimensions::npy=48 Processor Dimensions::npz=46 Local Domain Dimensions= Local Domain Dimensions::nx=128 Local Domain Dimensions::ny=128 Local Domain Dimensions::Lower ipz=0 Local Domain Dimensions::Upper ipz=45 Local Domain Dimensions::nz=128 ########## Problem Summary ##########= Setup Information= Setup Information::Setup Time=14.6691 Linear System Information= Linear System Information::Number of Equations=259308650496 Linear System Information::Number of Nonzero Terms=6999130211320 Multigrid Information= Multigrid Information::Number of coarse grid levels=3 Multigrid Information::Coarse Grids= Multigrid Information::Coarse Grids::Grid Level=1 Multigrid Information::Coarse Grids::Number of Equations=32413581312 Multigrid Information::Coarse Grids::Number of Nonzero Terms=874615915000 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 Multigrid Information::Coarse Grids::Grid Level=2 Multigrid Information::Coarse Grids::Number of Equations=4051697664 Multigrid Information::Coarse Grids::Number of Nonzero Terms=109258170616 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 Multigrid Information::Coarse Grids::Grid Level=3 Multigrid Information::Coarse Grids::Number of Equations=506462208 Multigrid Information::Coarse Grids::Number of Nonzero Terms=13640077432 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 ########## Memory Use Summary ##########= Memory Use Information= Memory Use Information::Total memory used for data (Gbytes)=185456 Memory Use Information::Memory used for OptimizeProblem data (Gbytes)=0 Memory Use Information::Bytes per equation (Total memory / Number of Equations)=715.193 Memory Use Information::Memory used for linear system and CG (Gbytes)=163203 Memory Use Information::Coarse Grids= Memory Use Information::Coarse Grids::Grid Level=1 Memory Use Information::Coarse Grids::Memory used=19505.3 Memory Use Information::Coarse Grids::Grid Level=2 Memory Use Information::Coarse Grids::Memory used=2441.34 Memory Use Information::Coarse Grids::Grid Level=3 Memory Use Information::Coarse Grids::Memory used=306 ########## V&V Testing Summary ##########= Spectral Convergence Tests= Spectral Convergence Tests::Result=PASSED Spectral Convergence Tests::Unpreconditioned= Spectral Convergence Tests::Unpreconditioned::Maximum iteration count=11 Spectral Convergence Tests::Unpreconditioned::Expected iteration count=12 Spectral Convergence Tests::Preconditioned= Spectral Convergence Tests::Preconditioned::Maximum iteration count=2 Spectral Convergence Tests::Preconditioned::Expected iteration count=2 Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon= Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Result=PASSED Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Departure for SpMV=5.38069e-14 Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Departure for MG=4.83698e-13 ########## Iterations Summary ##########= Iteration Count Information= Iteration Count Information::Result=PASSED Iteration Count Information::Reference CG iterations per set=50 Iteration Count Information::Optimized CG iterations per set=50 Iteration Count Information::Total number of reference iterations=1200 Iteration Count Information::Total number of optimized iterations=1200 ########## Reproducibility Summary ##########= Reproducibility Information= Reproducibility Information::Result=PASSED Reproducibility Information::Scaled residual mean=0.00507163 Reproducibility Information::Scaled residual variance=0 ########## Performance Summary (times in sec) ##########= Benchmark Time Summary= Benchmark Time Summary::Optimization phase=8.1e-08 Benchmark Time Summary::DDOT=218.543 Benchmark Time Summary::WAXPBY=48.9532 Benchmark Time Summary::SpMV=260.287 Benchmark Time Summary::MG=1409.91 Benchmark Time Summary::Total=1937.94 Floating Point Operations Summary= Floating Point Operations Summary::Raw DDOT=1.87947e+15 Floating Point Operations Summary::Raw WAXPBY=1.87947e+15 Floating Point Operations Summary::Raw SpMV=1.71339e+16 Floating Point Operations Summary::Raw MG=9.58615e+16 Floating Point Operations Summary::Total=1.16754e+17 Floating Point Operations Summary::Total with convergence overhead=1.16754e+17 GB/s Summary= GB/s Summary::Raw Read B/W=371068 GB/s Summary::Raw Write B/W=85748.5 GB/s Summary::Raw Total B/W=456817 GB/s Summary::Total with convergence and optimization phase overhead=448666 GFLOP/s Summary= GFLOP/s Summary::Raw DDOT=8600 GFLOP/s Summary::Raw WAXPBY=38393.2 GFLOP/s Summary::Raw SpMV=65826.8 GFLOP/s Summary::Raw MG=67991 GFLOP/s Summary::Raw Total=60246.8 GFLOP/s Summary::Total with convergence overhead=60246.8 GFLOP/s Summary::Total with convergence and optimization phase overhead=59171.8 User Optimization Overheads= User Optimization Overheads::Optimization phase time (sec)=8.1e-08 User Optimization Overheads::Optimization phase time vs reference SpMV+MG time=5.49783e-08 DDOT Timing Variations= DDOT Timing Variations::Min DDOT MPI_Allreduce time=91.8969 DDOT Timing Variations::Max DDOT MPI_Allreduce time=204.02 DDOT Timing Variations::Avg DDOT MPI_Allreduce time=107.667 Final Summary= Final Summary::HPCG result is VALID with a GFLOP/s rating of=59171.8 Final Summary::HPCG 2.4 rating for historical reasons is=60246.8 Final Summary::Reference version of ComputeDotProduct used=Performance results are most likely suboptimal Final Summary::Reference version of ComputeSPMV used=Performance results are most likely suboptimal Final Summary::Reference version of ComputeMG used=Performance results are most likely suboptimal Final Summary::Reference version of ComputeWAXPBY used=Performance results are most likely suboptimal Final Summary::Please upload results from the YAML file contents to=http://hpcg-benchmark.org