HPCG-CUDA-Benchmark version=1.0.0 HPCG-Benchmark version=3.1 Machine Summary= Machine Summary::Distributed Processes=360 Machine Summary::Threads per processes=4 Global Problem Dimensions= Global Problem Dimensions::Global nx=3840 Global Problem Dimensions::Global ny=3840 Global Problem Dimensions::Global nz=1600 Processor Dimensions= Processor Dimensions::npx=6 Processor Dimensions::npy=6 Processor Dimensions::npz=10 Local Domain Dimensions= Local Domain Dimensions::nx=640 Local Domain Dimensions::ny=640 Local Domain Dimensions::Lower ipz=0 Local Domain Dimensions::Upper ipz=9 Local Domain Dimensions::nz=160 ########## Problem Summary ##########= Setup Information= Setup Information::Setup Time=0.937653 Linear System Information= Linear System Information::Number of Equations=23592960000 Linear System Information::Number of Nonzero Terms=636523426552 Multigrid Information= Multigrid Information::Number of coarse grid levels=3 Multigrid Information::Coarse Grids= Multigrid Information::Coarse Grids::Grid Level=1 Multigrid Information::Coarse Grids::Number of Equations=2949120000 Multigrid Information::Coarse Grids::Number of Nonzero Terms=79504644472 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 Multigrid Information::Coarse Grids::Grid Level=2 Multigrid Information::Coarse Grids::Number of Equations=368640000 Multigrid Information::Coarse Grids::Number of Nonzero Terms=9922895032 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 Multigrid Information::Coarse Grids::Grid Level=3 Multigrid Information::Coarse Grids::Number of Equations=46080000 Multigrid Information::Coarse Grids::Number of Nonzero Terms=1236570712 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 ########## Memory Use Summary ##########= Memory Use Information= Memory Use Information::Total memory used for data (Gbytes)=16866.4 Memory Use Information::Memory used for OptimizeProblem data (Gbytes)=0 Memory Use Information::Bytes per equation (Total memory / Number of Equations)=714.889 Memory Use Information::Memory used for linear system and CG (Gbytes)=14843.5 Memory Use Information::Coarse Grids= Memory Use Information::Coarse Grids::Grid Level=1 Memory Use Information::Coarse Grids::Memory used=1773.31 Memory Use Information::Coarse Grids::Grid Level=2 Memory Use Information::Coarse Grids::Memory used=221.776 Memory Use Information::Coarse Grids::Grid Level=3 Memory Use Information::Coarse Grids::Memory used=27.7505 ########## V&V Testing Summary ##########= Spectral Convergence Tests= Spectral Convergence Tests::Result=PASSED Spectral Convergence Tests::Unpreconditioned= Spectral Convergence Tests::Unpreconditioned::Maximum iteration count=11 Spectral Convergence Tests::Unpreconditioned::Expected iteration count=12 Spectral Convergence Tests::Preconditioned= Spectral Convergence Tests::Preconditioned::Maximum iteration count=2 Spectral Convergence Tests::Preconditioned::Expected iteration count=2 Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon= Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Result=PASSED Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Departure for SpMV=3.40702e-15 Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Departure for MG=0 ########## Iterations Summary ##########= Iteration Count Information= Iteration Count Information::Result=PASSED Iteration Count Information::Reference CG iterations per set=50 Iteration Count Information::Optimized CG iterations per set=52 Iteration Count Information::Total number of reference iterations=18600 Iteration Count Information::Total number of optimized iterations=19344 ########## Reproducibility Summary ##########= Reproducibility Information= Reproducibility Information::Result=PASSED Reproducibility Information::Scaled residual mean=0.00515055 Reproducibility Information::Scaled residual variance=0 ########## Performance Summary (times in sec) ##########= Benchmark Time Summary= Benchmark Time Summary::Optimization phase=0.397742 Benchmark Time Summary::DDOT=66.2558 Benchmark Time Summary::WAXPBY=69.1234 Benchmark Time Summary::SpMV=360.312 Benchmark Time Summary::MG=1397.05 Benchmark Time Summary::Total=1892.79 Floating Point Operations Summary= Floating Point Operations Summary::Raw DDOT=2.75585e+15 Floating Point Operations Summary::Raw WAXPBY=2.75585e+15 Floating Point Operations Summary::Raw SpMV=2.50994e+16 Floating Point Operations Summary::Raw MG=1.40524e+17 Floating Point Operations Summary::Total=1.71135e+17 Floating Point Operations Summary::Total with convergence overhead=1.64553e+17 GB/s Summary= GB/s Summary::Raw Read B/W=556878 GB/s Summary::Raw Write B/W=128699 GB/s Summary::Raw Total B/W=685577 GB/s Summary::Total with convergence and optimization phase overhead=642350 GFLOP/s Summary= GFLOP/s Summary::Raw DDOT=41594 GFLOP/s Summary::Raw WAXPBY=39868.5 GFLOP/s Summary::Raw SpMV=69660.1 GFLOP/s Summary::Raw MG=100586 GFLOP/s Summary::Raw Total=90414 GFLOP/s Summary::Total with convergence overhead=86936.5 GFLOP/s Summary::Total with convergence and optimization phase overhead=84713.2 User Optimization Overheads= User Optimization Overheads::Optimization phase time (sec)=0.397742 User Optimization Overheads::Optimization phase time vs reference SpMV+MG time=0.0338688 DDOT Timing Variations= DDOT Timing Variations::Min DDOT MPI_Allreduce time=3.34845 DDOT Timing Variations::Max DDOT MPI_Allreduce time=36.5779 DDOT Timing Variations::Avg DDOT MPI_Allreduce time=17.2024 Final Summary= Final Summary::HPCG result is VALID with a GFLOP/s rating of=84713.2 Final Summary::HPCG 2.4 rating for historical reasons is=86262.2 Final Summary::Please upload results from the YAML file contents to=http://hpcg-benchmark.org