HPCG-CUDA-Benchmark v1.0.0 HPCG-Benchmark v3.1 start of application (128 OMP threads)... 2021-11-04 15:08:25.529 Problem setup... Setup time: 0.890280 sec GPU: 'NVIDIA A100-SXM4-40GB' Memory use: 37002 MB / 40536 MB 4x8x6 process grid 512x512x288 local domain Reference SpMV+MG... Reference CG... Initial Residual: 5.550554e+04 Max_err: 1.000000e+00 tot_err: 1.203973e+05 REF Iter = 1 Scaled Residual: 1.884746e-01 Max error: 1.000000e+00 tot_error: 9.966131e-01 REF Iter = 2 Scaled Residual: 1.038456e-01 Max error: 1.000000e+00 tot_error: 9.934657e-01 REF Iter = 3 Scaled Residual: 7.177522e-02 Max error: 1.000000e+00 tot_error: 9.903625e-01 REF Iter = 4 Scaled Residual: 5.486970e-02 Max error: 1.000000e+00 tot_error: 9.872711e-01 REF Iter = 5 Scaled Residual: 4.438385e-02 Max error: 1.000000e+00 tot_error: 9.841835e-01 REF Iter = 6 Scaled Residual: 3.724517e-02 Max error: 1.000000e+00 tot_error: 9.810981e-01 REF Iter = 7 Scaled Residual: 3.208539e-02 Max error: 1.000000e+00 tot_error: 9.780144e-01 REF Iter = 8 Scaled Residual: 2.820155e-02 Max error: 1.000000e+00 tot_error: 9.749331e-01 REF Iter = 9 Scaled Residual: 2.518666e-02 Max error: 1.000000e+00 tot_error: 9.718546e-01 REF Iter = 10 Scaled Residual: 2.278038e-02 Max error: 1.000000e+00 tot_error: 9.687796e-01 REF Iter = 11 Scaled Residual: 2.080720e-02 Max error: 1.000000e+00 tot_error: 9.657078e-01 REF Iter = 12 Scaled Residual: 1.914633e-02 Max error: 1.000000e+00 tot_error: 9.626388e-01 REF Iter = 13 Scaled Residual: 1.771514e-02 Max error: 1.000000e+00 tot_error: 9.595717e-01 REF Iter = 14 Scaled Residual: 1.646388e-02 Max error: 1.000000e+00 tot_error: 9.565056e-01 REF Iter = 15 Scaled Residual: 1.536439e-02 Max error: 1.000000e+00 tot_error: 9.534404e-01 REF Iter = 16 Scaled Residual: 1.439897e-02 Max error: 1.000000e+00 tot_error: 9.503763e-01 REF Iter = 17 Scaled Residual: 1.355510e-02 Max error: 1.000000e+00 tot_error: 9.473139e-01 REF Iter = 18 Scaled Residual: 1.281927e-02 Max error: 1.000000e+00 tot_error: 9.442542e-01 REF Iter = 19 Scaled Residual: 1.217431e-02 Max error: 1.000000e+00 tot_error: 9.411979e-01 REF Iter = 20 Scaled Residual: 1.160195e-02 Max error: 1.000000e+00 tot_error: 9.381451e-01 REF Iter = 21 Scaled Residual: 1.108399e-02 Max error: 1.000000e+00 tot_error: 9.350956e-01 REF Iter = 22 Scaled Residual: 1.060549e-02 Max error: 1.000000e+00 tot_error: 9.320488e-01 REF Iter = 23 Scaled Residual: 1.015956e-02 Max error: 1.000000e+00 tot_error: 9.290037e-01 REF Iter = 24 Scaled Residual: 9.746053e-03 Max error: 1.000000e+00 tot_error: 9.259599e-01 REF Iter = 25 Scaled Residual: 9.368419e-03 Max error: 1.000000e+00 tot_error: 9.229178e-01 REF Iter = 26 Scaled Residual: 9.031468e-03 Max error: 1.000000e+00 tot_error: 9.198778e-01 REF Iter = 27 Scaled Residual: 8.736839e-03 Max error: 1.000000e+00 tot_error: 9.168413e-01 REF Iter = 28 Scaled Residual: 8.480737e-03 Max error: 1.000000e+00 tot_error: 9.138093e-01 REF Iter = 29 Scaled Residual: 8.254899e-03 Max error: 1.000000e+00 tot_error: 9.107824e-01 REF Iter = 30 Scaled Residual: 8.047107e-03 Max error: 1.000000e+00 tot_error: 9.077607e-01 REF Iter = 31 Scaled Residual: 7.845541e-03 Max error: 1.000000e+00 tot_error: 9.047436e-01 REF Iter = 32 Scaled Residual: 7.644336e-03 Max error: 1.000000e+00 tot_error: 9.017302e-01 REF Iter = 33 Scaled Residual: 7.443466e-03 Max error: 1.000000e+00 tot_error: 8.987202e-01 REF Iter = 34 Scaled Residual: 7.246588e-03 Max error: 1.000000e+00 tot_error: 8.957133e-01 REF Iter = 35 Scaled Residual: 7.057048e-03 Max error: 1.000000e+00 tot_error: 8.927103e-01 REF Iter = 36 Scaled Residual: 6.873083e-03 Max error: 1.000000e+00 tot_error: 8.897116e-01 REF Iter = 37 Scaled Residual: 6.689096e-03 Max error: 1.000000e+00 tot_error: 8.867169e-01 REF Iter = 38 Scaled Residual: 6.500246e-03 Max error: 1.000000e+00 tot_error: 8.837249e-01 REF Iter = 39 Scaled Residual: 6.306138e-03 Max error: 1.000000e+00 tot_error: 8.807341e-01 REF Iter = 40 Scaled Residual: 6.113389e-03 Max error: 1.000000e+00 tot_error: 8.777428e-01 REF Iter = 41 Scaled Residual: 5.932587e-03 Max error: 1.000000e+00 tot_error: 8.747510e-01 REF Iter = 42 Scaled Residual: 5.772468e-03 Max error: 1.000000e+00 tot_error: 8.717595e-01 REF Iter = 43 Scaled Residual: 5.637424e-03 Max error: 1.000000e+00 tot_error: 8.687698e-01 REF Iter = 44 Scaled Residual: 5.526146e-03 Max error: 1.000000e+00 tot_error: 8.657837e-01 REF Iter = 45 Scaled Residual: 5.431507e-03 Max error: 1.000000e+00 tot_error: 8.628018e-01 REF Iter = 46 Scaled Residual: 5.343853e-03 Max error: 1.000000e+00 tot_error: 8.598238e-01 REF Iter = 47 Scaled Residual: 5.254772e-03 Max error: 1.000000e+00 tot_error: 8.568494e-01 REF Iter = 48 Scaled Residual: 5.160469e-03 Max error: 1.000000e+00 tot_error: 8.538779e-01 REF Iter = 49 Scaled Residual: 5.063092e-03 Max error: 1.000000e+00 tot_error: 8.509090e-01 REF Iter = 50 Scaled Residual: 4.966630e-03 Max error: 1.000000e+00 tot_error: 8.479430e-01 Optimization... Optimization time: 4.079970e-01 sec Validation... Optimized CG Setup... Initial Residual: 5.550554e+04 Max_err: 1.000000e+00 tot_err: 1.203973e+05 Iteration = 1 Scaled Residual: 2.205204e-01 Max error: 1.000000e+00 tot_error: 9.965926e-01 Iteration = 2 Scaled Residual: 1.193405e-01 Max error: 1.000000e+00 tot_error: 9.933904e-01 Iteration = 3 Scaled Residual: 8.125249e-02 Max error: 1.000000e+00 tot_error: 9.902505e-01 Iteration = 4 Scaled Residual: 6.158705e-02 Max error: 1.000000e+00 tot_error: 9.871339e-01 Iteration = 5 Scaled Residual: 4.964790e-02 Max error: 1.000000e+00 tot_error: 9.840224e-01 Iteration = 6 Scaled Residual: 4.158863e-02 Max error: 1.000000e+00 tot_error: 9.809137e-01 Iteration = 7 Scaled Residual: 3.579697e-02 Max error: 1.000000e+00 tot_error: 9.778049e-01 Iteration = 8 Scaled Residual: 3.143868e-02 Max error: 1.000000e+00 tot_error: 9.746964e-01 Iteration = 9 Scaled Residual: 2.802815e-02 Max error: 1.000000e+00 tot_error: 9.715882e-01 Iteration = 10 Scaled Residual: 2.529106e-02 Max error: 1.000000e+00 tot_error: 9.684812e-01 Iteration = 11 Scaled Residual: 2.304625e-02 Max error: 1.000000e+00 tot_error: 9.653748e-01 Iteration = 12 Scaled Residual: 2.116814e-02 Max error: 1.000000e+00 tot_error: 9.622699e-01 Iteration = 13 Scaled Residual: 1.957841e-02 Max error: 1.000000e+00 tot_error: 9.591663e-01 Iteration = 14 Scaled Residual: 1.821414e-02 Max error: 1.000000e+00 tot_error: 9.560644e-01 Iteration = 15 Scaled Residual: 1.702905e-02 Max error: 1.000000e+00 tot_error: 9.529641e-01 Iteration = 16 Scaled Residual: 1.599226e-02 Max error: 1.000000e+00 tot_error: 9.498659e-01 Iteration = 17 Scaled Residual: 1.507776e-02 Max error: 1.000000e+00 tot_error: 9.467696e-01 Iteration = 18 Scaled Residual: 1.426645e-02 Max error: 1.000000e+00 tot_error: 9.436757e-01 Iteration = 19 Scaled Residual: 1.354282e-02 Max error: 1.000000e+00 tot_error: 9.405840e-01 Iteration = 20 Scaled Residual: 1.289377e-02 Max error: 1.000000e+00 tot_error: 9.374950e-01 Iteration = 21 Scaled Residual: 1.230992e-02 Max error: 1.000000e+00 tot_error: 9.344086e-01 Iteration = 22 Scaled Residual: 1.178301e-02 Max error: 1.000000e+00 tot_error: 9.313256e-01 Iteration = 23 Scaled Residual: 1.130611e-02 Max error: 1.000000e+00 tot_error: 9.282456e-01 Iteration = 24 Scaled Residual: 1.087275e-02 Max error: 1.000000e+00 tot_error: 9.251695e-01 Iteration = 25 Scaled Residual: 1.047608e-02 Max error: 1.000000e+00 tot_error: 9.220968e-01 Iteration = 26 Scaled Residual: 1.011131e-02 Max error: 1.000000e+00 tot_error: 9.190284e-01 Iteration = 27 Scaled Residual: 9.773083e-03 Max error: 1.000000e+00 tot_error: 9.159638e-01 Iteration = 28 Scaled Residual: 9.455784e-03 Max error: 1.000000e+00 tot_error: 9.129035e-01 Iteration = 29 Scaled Residual: 9.155286e-03 Max error: 1.000000e+00 tot_error: 9.098466e-01 Iteration = 30 Scaled Residual: 8.867443e-03 Max error: 1.000000e+00 tot_error: 9.067936e-01 Iteration = 31 Scaled Residual: 8.589683e-03 Max error: 1.000000e+00 tot_error: 9.037431e-01 Iteration = 32 Scaled Residual: 8.321807e-03 Max error: 1.000000e+00 tot_error: 9.006955e-01 Iteration = 33 Scaled Residual: 8.063346e-03 Max error: 1.000000e+00 tot_error: 8.976496e-01 Iteration = 34 Scaled Residual: 7.815349e-03 Max error: 1.000000e+00 tot_error: 8.946056e-01 Iteration = 35 Scaled Residual: 7.579799e-03 Max error: 1.000000e+00 tot_error: 8.915628e-01 Iteration = 36 Scaled Residual: 7.357544e-03 Max error: 1.000000e+00 tot_error: 8.885216e-01 Iteration = 37 Scaled Residual: 7.149542e-03 Max error: 1.000000e+00 tot_error: 8.854817e-01 Iteration = 38 Scaled Residual: 6.956234e-03 Max error: 1.000000e+00 tot_error: 8.824437e-01 Iteration = 39 Scaled Residual: 6.776608e-03 Max error: 1.000000e+00 tot_error: 8.794077e-01 Iteration = 40 Scaled Residual: 6.610215e-03 Max error: 1.000000e+00 tot_error: 8.763743e-01 Iteration = 41 Scaled Residual: 6.456237e-03 Max error: 1.000000e+00 tot_error: 8.733437e-01 Iteration = 42 Scaled Residual: 6.312861e-03 Max error: 1.000000e+00 tot_error: 8.703166e-01 Iteration = 43 Scaled Residual: 6.178786e-03 Max error: 1.000000e+00 tot_error: 8.672931e-01 Iteration = 44 Scaled Residual: 6.052283e-03 Max error: 1.000000e+00 tot_error: 8.642737e-01 Iteration = 45 Scaled Residual: 5.930857e-03 Max error: 1.000000e+00 tot_error: 8.612578e-01 Iteration = 46 Scaled Residual: 5.812616e-03 Max error: 1.000000e+00 tot_error: 8.582453e-01 Iteration = 47 Scaled Residual: 5.695312e-03 Max error: 1.000000e+00 tot_error: 8.552355e-01 Iteration = 48 Scaled Residual: 5.577069e-03 Max error: 1.000000e+00 tot_error: 8.522279e-01 Iteration = 49 Scaled Residual: 5.458167e-03 Max error: 1.000000e+00 tot_error: 8.492223e-01 Iteration = 50 Scaled Residual: 5.339811e-03 Max error: 1.000000e+00 tot_error: 8.462184e-01 Iteration = 51 Scaled Residual: 5.223681e-03 Max error: 1.000000e+00 tot_error: 8.432155e-01 Iteration = 52 Scaled Residual: 5.111947e-03 Max error: 1.000000e+00 tot_error: 8.402135e-01 Iteration = 53 Scaled Residual: 5.006211e-03 Max error: 1.000000e+00 tot_error: 8.372128e-01 Iteration = 54 Scaled Residual: 4.908014e-03 Max error: 1.000000e+00 tot_error: 8.342136e-01 Starting Benchmarking Phase... Performing 297 CG sets expected time: 1810.0 seconds expected Perf: 43624.7 GF (227.2 GF_per) 2021-11-04 15:26:38.042 progress = 1.0% 18.3 / 1810.0 sec elapsed 1791.7 sec remain 43533.235 GF 226.736 GF_per progress = 2.0% 36.7 / 1810.0 sec elapsed 1773.3 sec remain 43548.509 GF 226.815 GF_per progress = 3.0% 55.0 / 1810.0 sec elapsed 1755.0 sec remain 43546.178 GF 226.803 GF_per progress = 4.1% 73.5 / 1810.0 sec elapsed 1736.5 sec remain 43468.018 GF 226.396 GF_per progress = 5.1% 91.9 / 1810.0 sec elapsed 1718.1 sec remain 43440.010 GF 226.250 GF_per progress = 6.1% 110.4 / 1810.0 sec elapsed 1699.6 sec remain 43401.325 GF 226.049 GF_per progress = 7.1% 128.8 / 1810.0 sec elapsed 1681.2 sec remain 43392.606 GF 226.003 GF_per progress = 8.1% 147.3 / 1810.0 sec elapsed 1662.7 sec remain 43365.236 GF 225.861 GF_per progress = 9.2% 165.8 / 1810.0 sec elapsed 1644.2 sec remain 43338.598 GF 225.722 GF_per progress = 10.2% 184.3 / 1810.0 sec elapsed 1625.7 sec remain 43319.480 GF 225.622 GF_per progress = 11.2% 202.7 / 1810.0 sec elapsed 1607.3 sec remain 43310.684 GF 225.576 GF_per progress = 12.2% 221.2 / 1810.0 sec elapsed 1588.8 sec remain 43308.429 GF 225.565 GF_per progress = 13.2% 239.6 / 1810.0 sec elapsed 1570.4 sec remain 43305.793 GF 225.551 GF_per progress = 14.3% 258.1 / 1810.0 sec elapsed 1551.9 sec remain 43305.225 GF 225.548 GF_per progress = 15.3% 276.5 / 1810.0 sec elapsed 1533.5 sec remain 43298.494 GF 225.513 GF_per progress = 16.3% 295.0 / 1810.0 sec elapsed 1515.0 sec remain 43299.759 GF 225.520 GF_per progress = 17.3% 313.4 / 1810.0 sec elapsed 1496.6 sec remain 43297.140 GF 225.506 GF_per progress = 18.3% 331.9 / 1810.0 sec elapsed 1478.1 sec remain 43290.471 GF 225.471 GF_per progress = 19.4% 350.4 / 1810.0 sec elapsed 1459.6 sec remain 43286.212 GF 225.449 GF_per progress = 20.4% 368.9 / 1810.0 sec elapsed 1441.1 sec remain 43281.780 GF 225.426 GF_per progress = 21.4% 387.3 / 1810.0 sec elapsed 1422.7 sec remain 43286.168 GF 225.449 GF_per progress = 22.4% 405.7 / 1810.0 sec elapsed 1404.3 sec remain 43287.626 GF 225.456 GF_per progress = 23.4% 424.2 / 1810.0 sec elapsed 1385.8 sec remain 43287.759 GF 225.457 GF_per progress = 24.5% 442.6 / 1810.0 sec elapsed 1367.4 sec remain 43284.412 GF 225.440 GF_per progress = 25.5% 461.1 / 1810.0 sec elapsed 1348.9 sec remain 43282.443 GF 225.429 GF_per progress = 26.5% 479.6 / 1810.0 sec elapsed 1330.4 sec remain 43280.250 GF 225.418 GF_per progress = 27.5% 498.1 / 1810.0 sec elapsed 1311.9 sec remain 43274.782 GF 225.389 GF_per progress = 28.5% 516.5 / 1810.0 sec elapsed 1293.5 sec remain 43273.779 GF 225.384 GF_per progress = 29.6% 535.0 / 1810.0 sec elapsed 1275.0 sec remain 43271.083 GF 225.370 GF_per progress = 30.6% 553.5 / 1810.0 sec elapsed 1256.5 sec remain 43270.295 GF 225.366 GF_per progress = 31.6% 571.9 / 1810.0 sec elapsed 1238.1 sec remain 43271.108 GF 225.370 GF_per progress = 32.6% 590.3 / 1810.0 sec elapsed 1219.7 sec remain 43273.073 GF 225.381 GF_per progress = 33.6% 608.7 / 1810.0 sec elapsed 1201.3 sec remain 43275.201 GF 225.392 GF_per progress = 34.7% 627.2 / 1810.0 sec elapsed 1182.8 sec remain 43272.733 GF 225.379 GF_per progress = 35.7% 645.7 / 1810.0 sec elapsed 1164.3 sec remain 43270.790 GF 225.369 GF_per progress = 36.7% 664.1 / 1810.0 sec elapsed 1145.9 sec remain 43272.404 GF 225.377 GF_per progress = 37.7% 682.6 / 1810.0 sec elapsed 1127.4 sec remain 43272.384 GF 225.377 GF_per progress = 38.7% 701.1 / 1810.0 sec elapsed 1108.9 sec remain 43270.453 GF 225.367 GF_per progress = 39.8% 719.5 / 1810.0 sec elapsed 1090.5 sec remain 43269.648 GF 225.363 GF_per progress = 40.8% 738.0 / 1810.0 sec elapsed 1072.0 sec remain 43269.188 GF 225.360 GF_per progress = 41.8% 756.4 / 1810.0 sec elapsed 1053.6 sec remain 43268.998 GF 225.359 GF_per progress = 42.8% 774.9 / 1810.0 sec elapsed 1035.1 sec remain 43269.941 GF 225.364 GF_per progress = 43.8% 793.3 / 1810.0 sec elapsed 1016.7 sec remain 43270.001 GF 225.365 GF_per progress = 44.8% 811.8 / 1810.0 sec elapsed 998.2 sec remain 43270.076 GF 225.365 GF_per progress = 45.9% 830.2 / 1810.0 sec elapsed 979.8 sec remain 43268.223 GF 225.355 GF_per progress = 46.9% 848.7 / 1810.0 sec elapsed 961.3 sec remain 43267.657 GF 225.352 GF_per progress = 47.9% 867.2 / 1810.0 sec elapsed 942.8 sec remain 43267.548 GF 225.352 GF_per progress = 48.9% 885.6 / 1810.0 sec elapsed 924.4 sec remain 43266.971 GF 225.349 GF_per progress = 49.9% 904.1 / 1810.0 sec elapsed 905.9 sec remain 43266.333 GF 225.345 GF_per progress = 51.0% 922.5 / 1810.0 sec elapsed 887.5 sec remain 43266.399 GF 225.346 GF_per progress = 52.0% 941.0 / 1810.0 sec elapsed 869.0 sec remain 43265.179 GF 225.339 GF_per progress = 53.0% 959.5 / 1810.0 sec elapsed 850.5 sec remain 43265.029 GF 225.339 GF_per progress = 54.0% 977.9 / 1810.0 sec elapsed 832.1 sec remain 43264.804 GF 225.338 GF_per progress = 55.0% 996.4 / 1810.0 sec elapsed 813.6 sec remain 43265.328 GF 225.340 GF_per progress = 56.1% 1014.8 / 1810.0 sec elapsed 795.2 sec remain 43264.689 GF 225.337 GF_per progress = 57.1% 1033.3 / 1810.0 sec elapsed 776.7 sec remain 43264.701 GF 225.337 GF_per progress = 58.1% 1051.7 / 1810.0 sec elapsed 758.3 sec remain 43264.815 GF 225.338 GF_per progress = 59.1% 1070.1 / 1810.0 sec elapsed 739.9 sec remain 43266.170 GF 225.345 GF_per progress = 60.1% 1088.6 / 1810.0 sec elapsed 721.4 sec remain 43266.532 GF 225.347 GF_per progress = 61.2% 1107.0 / 1810.0 sec elapsed 703.0 sec remain 43267.068 GF 225.349 GF_per progress = 62.2% 1125.5 / 1810.0 sec elapsed 684.5 sec remain 43266.153 GF 225.345 GF_per progress = 63.2% 1144.0 / 1810.0 sec elapsed 666.0 sec remain 43264.366 GF 225.335 GF_per progress = 64.2% 1162.4 / 1810.0 sec elapsed 647.6 sec remain 43265.779 GF 225.343 GF_per progress = 65.2% 1180.9 / 1810.0 sec elapsed 629.1 sec remain 43264.688 GF 225.337 GF_per progress = 66.3% 1199.3 / 1810.0 sec elapsed 610.7 sec remain 43264.298 GF 225.335 GF_per progress = 67.3% 1217.8 / 1810.0 sec elapsed 592.2 sec remain 43263.930 GF 225.333 GF_per progress = 68.3% 1236.3 / 1810.0 sec elapsed 573.7 sec remain 43264.099 GF 225.334 GF_per progress = 69.3% 1254.7 / 1810.0 sec elapsed 555.3 sec remain 43264.001 GF 225.333 GF_per progress = 70.3% 1273.2 / 1810.0 sec elapsed 536.8 sec remain 43262.326 GF 225.325 GF_per progress = 71.4% 1291.7 / 1810.0 sec elapsed 518.3 sec remain 43261.064 GF 225.318 GF_per progress = 72.4% 1310.2 / 1810.0 sec elapsed 499.8 sec remain 43260.976 GF 225.318 GF_per progress = 73.4% 1328.7 / 1810.0 sec elapsed 481.3 sec remain 43259.046 GF 225.308 GF_per progress = 74.4% 1347.1 / 1810.0 sec elapsed 462.9 sec remain 43259.154 GF 225.308 GF_per progress = 75.4% 1365.6 / 1810.0 sec elapsed 444.4 sec remain 43259.588 GF 225.310 GF_per progress = 76.5% 1384.0 / 1810.0 sec elapsed 426.0 sec remain 43258.671 GF 225.306 GF_per progress = 77.5% 1402.5 / 1810.0 sec elapsed 407.5 sec remain 43258.154 GF 225.303 GF_per progress = 78.5% 1421.0 / 1810.0 sec elapsed 389.0 sec remain 43257.531 GF 225.300 GF_per progress = 79.5% 1439.5 / 1810.0 sec elapsed 370.5 sec remain 43256.781 GF 225.296 GF_per progress = 80.5% 1457.9 / 1810.0 sec elapsed 352.1 sec remain 43256.567 GF 225.295 GF_per progress = 81.6% 1476.4 / 1810.0 sec elapsed 333.6 sec remain 43255.904 GF 225.291 GF_per progress = 82.6% 1494.9 / 1810.0 sec elapsed 315.1 sec remain 43255.455 GF 225.289 GF_per progress = 83.6% 1513.4 / 1810.0 sec elapsed 296.6 sec remain 43254.418 GF 225.283 GF_per progress = 84.6% 1531.8 / 1810.0 sec elapsed 278.2 sec remain 43254.132 GF 225.282 GF_per progress = 85.7% 1550.3 / 1810.0 sec elapsed 259.7 sec remain 43254.443 GF 225.284 GF_per progress = 86.7% 1568.7 / 1810.0 sec elapsed 241.3 sec remain 43255.501 GF 225.289 GF_per progress = 87.7% 1587.2 / 1810.0 sec elapsed 222.8 sec remain 43255.714 GF 225.290 GF_per progress = 88.7% 1605.6 / 1810.0 sec elapsed 204.4 sec remain 43256.055 GF 225.292 GF_per progress = 89.7% 1624.1 / 1810.0 sec elapsed 185.9 sec remain 43256.016 GF 225.292 GF_per progress = 90.7% 1642.5 / 1810.0 sec elapsed 167.5 sec remain 43255.918 GF 225.291 GF_per progress = 91.8% 1661.0 / 1810.0 sec elapsed 149.0 sec remain 43254.972 GF 225.286 GF_per progress = 92.8% 1679.5 / 1810.0 sec elapsed 130.5 sec remain 43254.888 GF 225.286 GF_per progress = 93.8% 1697.9 / 1810.0 sec elapsed 112.1 sec remain 43254.854 GF 225.286 GF_per progress = 94.8% 1716.4 / 1810.0 sec elapsed 93.6 sec remain 43254.898 GF 225.286 GF_per progress = 95.8% 1734.8 / 1810.0 sec elapsed 75.2 sec remain 43255.100 GF 225.287 GF_per progress = 96.9% 1753.3 / 1810.0 sec elapsed 56.7 sec remain 43255.625 GF 225.290 GF_per progress = 97.9% 1771.7 / 1810.0 sec elapsed 38.3 sec remain 43255.794 GF 225.291 GF_per progress = 98.9% 1790.2 / 1810.0 sec elapsed 19.8 sec remain 43255.185 GF 225.287 GF_per progress = 99.9% 1808.6 / 1810.0 sec elapsed 1.4 sec remain 43256.020 GF 225.292 GF_per Completed Benchmarking Phase... elapsed time: 1827.1 seconds 2021-11-04 15:57:05.134 Number of CG sets: 297 Iterations per set: 54 scaled res mean: 4.908014e-03 scaled res variance: 0.000000e+00 Total Time: 1.827079e+03 sec Setup Overhead: 1.43% Optimization Overhead: 0.66% Convergence Overhead: 7.41% 4x8x6 process grid 512x512x288 local domain SpMV = 37350.4 GF (235179.0 GB/s Effective) 194.5 GF_per (1224.9 GB/s Effective) SymGS = 54933.1 GF (423949.9 GB/s Effective) 286.1 GF_per (2208.1 GB/s Effective) total = 47701.9 GF (361713.4 GB/s Effective) 248.4 GF_per (1883.9 GB/s Effective) final = 43255.6 GF (327997.7 GB/s Effective) 225.3 GF_per (1708.3 GB/s Effective) end of application... 2021-11-04 15:57:05.430