HPCG-Benchmark version=3.1 Release date=March 28, 2019 Machine Summary= Machine Summary::Distributed Processes=362880 Machine Summary::Threads per processes=36 Global Problem Dimensions= Global Problem Dimensions::Global nx=27648 Global Problem Dimensions::Global ny=27648 Global Problem Dimensions::Global nz=4480 Processor Dimensions= Processor Dimensions::npx=72 Processor Dimensions::npy=72 Processor Dimensions::npz=70 Local Domain Dimensions= Local Domain Dimensions::nx=384 Local Domain Dimensions::ny=384 Local Domain Dimensions::Lower ipz=0 Local Domain Dimensions::Upper ipz=69 Local Domain Dimensions::nz=64 ########## Problem Summary##########= Setup Information= Setup Information::Setup Time=1.84199 Linear System Information= Linear System Information::Number of Equations=3424565329920 Linear System Information::Number of Nonzero Terms=92445046141432 Multigrid Information= Multigrid Information::Number of coarse grid levels=3 Multigrid Information::Coarse Grids= Multigrid Information::Coarse Grids::Grid Level=1 Multigrid Information::Coarse Grids::Number of Equations=428070666240 Multigrid Information::Coarse Grids::Number of Nonzero Terms=11553353726200 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 Multigrid Information::Coarse Grids::Grid Level=2 Multigrid Information::Coarse Grids::Number of Equations=53508833280 Multigrid Information::Coarse Grids::Number of Nonzero Terms=1443600022648 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 Multigrid Information::Coarse Grids::Grid Level=3 Multigrid Information::Coarse Grids::Number of Equations=6688604160 Multigrid Information::Coarse Grids::Number of Nonzero Terms=180307738168 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 ########## Memory Use Summary##########= Memory Use Information= Memory Use Information::Total memory used for data (Gbytes)=3.56813e+06 Memory Use Information::Memory used for OptimizeProblem data (Gbytes)=1.18329e+06 Memory Use Information::Bytes per equation (Total memory / Number of Equations)=1041.92 Memory Use Information::Memory used for linear system and CG (Gbytes)=2.09926e+06 Memory Use Information::Coarse Grids= Memory Use Information::Coarse Grids::Grid Level=1 Memory Use Information::Coarse Grids::Memory used=250411 Memory Use Information::Coarse Grids::Grid Level=2 Memory Use Information::Coarse Grids::Memory used=31269.3 Memory Use Information::Coarse Grids::Grid Level=3 Memory Use Information::Coarse Grids::Memory used=3900.86 ########## V&V Testing Summary##########= Spectral Convergence Tests= Spectral Convergence Tests::Result=PASSED Spectral Convergence Tests::Unpreconditioned= Spectral Convergence Tests::Unpreconditioned::Maximum iteration count=11 Spectral Convergence Tests::Unpreconditioned::Expected iteration count=12 Spectral Convergence Tests::Preconditioned= Spectral Convergence Tests::Preconditioned::Maximum iteration count=2 Spectral Convergence Tests::Preconditioned::Expected iteration count=2 Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon= Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Result=PASSED Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Departure for SpMV=7.24507e-17 Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Departure for MG=6.62407e-16 ########## Iterations Summary##########= Iteration Count Information= Iteration Count Information::Result=PASSED Iteration Count Information::Reference CG iterations per set=50 Iteration Count Information::Optimized CG iterations per set=54 Iteration Count Information::Total number of reference iterations=34450 Iteration Count Information::Total number of optimized iterations=37206 ########## Reproducibility Summary##########= Reproducibility Information= Reproducibility Information::Result=PASSED Reproducibility Information::Scaled residual mean=0.00490366 Reproducibility Information::Scaled residual variance=4.00698e-29 ########## Performance Summary (times in sec)##########= Benchmark Time Summary= Benchmark Time Summary::Optimization phase=0.70577 Benchmark Time Summary::DDOT=484.701 Benchmark Time Summary::WAXPBY=62.9 Benchmark Time Summary::SpMV=195.569 Benchmark Time Summary::MG=1087.54 Benchmark Time Summary::Total=1835.9 Floating Point Operations Summary= Floating Point Operations Summary::Raw DDOT=7.69205e+17 Floating Point Operations Summary::Raw WAXPBY=7.69205e+17 Floating Point Operations Summary::Raw SpMV=7.00641e+18 Floating Point Operations Summary::Raw MG=3.92576e+19 Floating Point Operations Summary::Total=4.78024e+19 Floating Point Operations Summary::Total with convergence overhead=4.42615e+19 GB/s Summary= GB/s Summary::Raw Read B/W=1.60368e+08 GB/s Summary::Raw Write B/W=4.14237e+06 GB/s Summary::Raw Total B/W=1.6451e+08 GB/s Summary::Total with convergence and optimization phase overhead=1.39031e+08 GFLOP/s Summary= GFLOP/s Summary::Raw DDOT=1.58697e+06 GFLOP/s Summary::Raw WAXPBY=1.2229e+07 GFLOP/s Summary::Raw SpMV=3.58257e+07 GFLOP/s Summary::Raw MG=3.60977e+07 GFLOP/s Summary::Raw Total=2.60376e+07 GFLOP/s Summary::Total with convergence overhead=2.41089e+07 GFLOP/s Summary::Total with convergence and optimization phase overhead=2.20049e+07 User Optimization Overheads= User Optimization Overheads::Optimization phase time (sec)=0.70577 User Optimization Overheads::Optimization phase time vs reference SpMV+MG time=0.339345 DDOT Timing Variations= DDOT Timing Variations::Min DDOT MPI_Allreduce time=95.1774 DDOT Timing Variations::Max DDOT MPI_Allreduce time=437.991 DDOT Timing Variations::Avg DDOT MPI_Allreduce time=307.708 Final Summary= Final Summary::HPCG result is VALID with a GFLOP/s rating of=2.20049e+07 Final Summary::HPCG 2.4 rating for historical reasons is=2.34868e+07 Final Summary::Please upload results from the YAML file contents to=http://hpcg-benchmark.org