collective one-sided pt2pt startup HOSTFILE sharc-node132.shef.ac.uk 1 insigneo-imsb.q@sharc-node132.shef.ac.uk UNDEFINED sharc-node131.shef.ac.uk 1 insigneo-imsb.q@sharc-node131.shef.ac.uk UNDEFINED sharc-node134.shef.ac.uk 1 insigneo-imsb.q@sharc-node134.shef.ac.uk UNDEFINED collective one-sided pt2pt startup OSU MICRO BENCHMARKS collective one-sided pt2pt startup Running startup benchmarks # OSU MPI Init Test v5.3.2 nprocs: 3, min: 52 ms, max: 723 ms, avg: 276 ms # OSU MPI Hello World Test v5.3.2 This is a test with 3 processes Running point to point benchmarks # OSU MPI Bi-Directional Bandwidth Test v5.3.2 # Size Bandwidth (MB/s) 1 2.10 2 4.49 4 9.22 8 19.18 16 35.63 32 73.17 64 156.22 128 314.46 256 638.57 512 1253.78 1024 2448.47 2048 4378.61 4096 6613.40 8192 9193.82 16384 9898.26 32768 11893.84 65536 18746.00 131072 20954.30 262144 22289.93 524288 23527.32 1048576 24187.52 2097152 23997.82 4194304 23611.33 # OSU MPI Bandwidth Test v5.3.2 # Size Bandwidth (MB/s) 1 2.09 2 4.19 4 8.57 8 17.87 16 31.67 32 64.70 64 139.42 128 276.74 256 554.41 512 1133.89 1024 2112.33 2048 3570.77 4096 5423.26 8192 7356.56 16384 7639.48 32768 10041.78 65536 10814.98 131072 12077.98 262144 12244.43 524288 12331.98 1048576 12372.53 2097152 12382.95 4194304 12384.22 # OSU MPI Latency Test v5.3.2 # Size Latency (us) 0 1.22 1 1.15 2 1.10 4 1.07 8 1.07 16 1.20 32 1.20 64 1.21 128 1.22 256 1.27 512 1.36 1024 1.47 2048 1.70 4096 2.15 8192 3.25 16384 6.38 32768 8.24 65536 16.28 131072 22.86 262144 32.22 524288 54.14 1048576 95.55 2097152 180.66 4194304 351.61 # OSU MPI Multiple Bandwidth / Message Rate Test v5.3.2 # [ pairs: 1 ] [ window size: 64 ] # Size MB/s Messages/s 1 1.97 1966272.02 2 3.94 1970313.09 4 8.32 2080572.44 8 16.80 2100269.59 16 29.73 1858070.58 32 63.29 1977862.19 64 131.22 2050377.76 128 265.80 2076548.74 256 541.18 2113997.92 512 1069.98 2089805.03 1024 2043.70 1995802.65 2048 3524.53 1720960.74 4096 5240.76 1279482.63 8192 7297.72 890835.48 16384 7279.12 444282.45 32768 9864.96 301054.74 65536 10694.99 163192.57 131072 12080.68 92168.26 262144 12247.09 46718.96 524288 12330.74 23519.02 1048576 12372.64 11799.46 2097152 12379.23 5902.88 4194304 12386.37 2953.14 # OSU MPI Multi Latency Test v5.3.2 # Size Latency (us) 0 1.34 1 1.25 2 1.16 4 1.11 8 1.06 16 1.15 32 1.14 64 1.13 128 1.15 256 1.20 512 1.26 1024 1.38 2048 1.61 4096 2.05 8192 3.08 16384 5.93 32768 7.77 65536 15.71 131072 22.34 262144 31.92 524288 53.60 1048576 95.47 2097152 180.89 4194304 350.51 # OSU MPI Multi-threaded Latency Test v5.3.2 # Size Latency (us) 0 1.89 1 1.92 2 1.61 4 1.50 8 1.49 16 1.66 32 1.65 64 1.64 128 1.63 256 1.65 512 1.69 1024 1.78 2048 2.46 4096 2.70 8192 3.72 16384 6.88 32768 8.62 65536 16.33 131072 23.42 262144 32.72 524288 53.82 1048576 95.79 2097152 180.49 4194304 350.46 Running collective benchmarks # OSU MPI All-to-Allv Personalized Exchange Latency Test v5.3.2 # Size Avg Latency(us) 1 3.41 2 3.65 4 3.21 8 3.47 16 4.96 32 4.95 64 4.63 128 4.36 256 4.24 512 4.21 1024 4.29 2048 4.61 4096 5.50 8192 6.98 16384 13.09 32768 19.46 65536 29.53 131072 48.51 262144 91.24 524288 166.74 1048576 317.65 # OSU MPI Allgatherv Latency Test v5.3.2 # Size Avg Latency(us) 1 3.64 2 3.51 4 3.60 8 3.45 16 6.17 32 5.53 64 5.47 128 5.33 256 5.31 512 5.45 1024 5.68 2048 6.37 4096 7.96 8192 11.30 16384 23.31 32768 25.23 65536 41.13 131072 62.55 262144 99.52 524288 164.31 1048576 319.04 # OSU MPI Scatterv Latency Test v5.3.2 # Size Avg Latency(us) 1 1.15 2 0.98 4 0.99 8 0.91 16 1.67 32 1.63 64 1.64 128 1.65 256 1.68 512 1.78 1024 1.93 2048 2.35 4096 2.99 8192 4.34 16384 9.27 32768 13.49 65536 23.64 131072 39.18 262144 72.52 524288 137.25 1048576 264.89 # OSU MPI Gatherv Latency Test v5.3.2 # Size Avg Latency(us) 1 1.31 2 1.24 4 1.24 8 1.17 16 1.30 32 1.26 64 1.24 128 1.22 256 1.23 512 1.24 1024 1.30 2048 1.44 4096 1.79 8192 2.47 16384 8.97 32768 12.32 65536 22.95 131072 39.10 262144 71.45 524288 135.30 1048576 261.41 # OSU MPI Reduce_scatter Latency Test v5.3.2 # Size Avg Latency(us) 4 2.64 8 2.60 16 3.55 32 3.57 64 4.37 128 4.28 256 4.27 512 4.35 1024 4.69 2048 5.28 4096 6.39 8192 8.66 16384 15.75 32768 27.27 65536 52.05 131072 80.14 262144 147.74 524288 113.72 1048576 199.10 # OSU MPI Barrier Latency Test v5.3.2 # Avg Latency(us) 3.92 # OSU MPI Reduce Latency Test v5.3.2 # Size Avg Latency(us) 4 1.95 8 1.86 16 3.31 32 3.33 64 1.62 128 1.65 256 1.68 512 1.79 1024 1.88 2048 2.04 4096 4.52 8192 6.20 16384 15.19 32768 16.83 65536 29.09 131072 49.41 262144 101.16 524288 191.85 1048576 366.35 # OSU MPI Allreduce Latency Test v5.3.2 # Size Avg Latency(us) 4 3.55 8 3.39 16 4.53 32 4.40 64 4.31 128 4.35 256 4.30 512 4.43 1024 4.82 2048 7.98 4096 7.30 8192 10.67 16384 25.92 32768 40.96 65536 69.58 131072 112.11 262144 181.25 524288 312.15 1048576 550.71 # OSU MPI All-to-All Personalized Exchange Latency Test v5.3.2 # Size Avg Latency(us) 1 3.61 2 3.49 4 3.37 8 3.31 16 5.14 32 5.00 64 4.90 128 4.78 256 4.88 512 4.99 1024 5.32 2048 5.96 4096 7.17 8192 9.54 16384 18.89 32768 25.26 65536 40.90 131072 61.31 262144 97.78 524288 172.89 1048576 322.59 # OSU MPI Broadcast Latency Test v5.3.2 # Size Avg Latency(us) 1 1.22 2 1.15 4 1.16 8 0.98 16 1.27 32 1.23 64 1.17 128 1.17 256 1.21 512 1.18 1024 1.25 2048 1.74 4096 2.34 8192 3.92 16384 13.88 32768 16.00 65536 34.59 131072 52.03 262144 81.54 524288 143.22 1048576 264.35 # OSU MPI Gather Latency Test v5.3.2 # Size Avg Latency(us) 1 1.55 2 1.39 4 1.48 8 1.34 16 1.37 32 1.36 64 1.30 128 1.31 256 1.30 512 1.35 1024 1.44 2048 1.55 4096 1.93 8192 2.58 16384 9.03 32768 13.70 65536 27.83 131072 42.67 262144 71.80 524288 135.92 1048576 261.95 # OSU MPI Allgather Latency Test v5.3.2 # Size Avg Latency(us) 1 3.49 2 3.50 4 3.37 8 3.80 16 5.16 32 5.53 64 4.89 128 4.86 256 5.47 512 5.12 1024 5.44 2048 6.05 4096 7.22 8192 9.54 16384 19.15 32768 25.26 65536 40.97 131072 91.47 262144 97.65 524288 163.54 1048576 319.77 # OSU MPI Scatter Latency Test v5.3.2 # Size Avg Latency(us) 1 1.13 2 1.09 4 1.07 8 1.02 16 1.24 32 1.95 64 1.20 128 1.19 256 1.22 512 1.28 1024 1.35 2048 1.69 4096 2.33 8192 3.74 16384 13.43 32768 17.61 65536 30.17 131072 44.04 262144 70.38 524288 119.28 1048576 219.49 # OSU MPI Non-blocking Allgather Latency Test v5.3.2 # Overall = Coll. Init + Compute + MPI_Test + MPI_Wait # Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%) 1 9.06 5.08 4.26 6.54 2 8.51 4.70 3.95 3.55 4 7.72 4.29 3.66 6.25 8 7.51 4.21 3.50 5.91 16 10.99 6.04 5.28 6.08 32 11.04 6.12 5.30 7.08 64 11.08 6.14 5.31 6.95 128 11.08 6.16 5.32 7.57 256 11.35 6.28 5.43 6.54 512 11.75 6.48 5.62 6.20 1024 12.40 6.86 6.01 7.77 2048 13.73 7.59 6.63 7.49 4096 16.65 9.13 8.12 7.36 8192 24.06 13.49 12.08 12.46 16384 46.98 26.53 24.05 14.94 32768 51.43 28.57 26.12 12.47 65536 92.63 47.46 42.40 0.00 131072 133.15 68.84 63.15 0.00 262144 204.03 105.83 97.41 0.00 524288 356.25 185.29 170.74 0.00 1048576 659.77 342.61 316.01 0.00 # OSU MPI Non-Blocking Broadcast Latency Test v5.3.2 # Overall = Coll. Init + Compute + MPI_Test + MPI_Wait # Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%) 1 3.97 2.25 1.72 0.00 2 3.79 2.20 1.56 0.00 4 3.53 2.04 1.46 0.00 8 3.35 1.96 1.37 0.00 16 3.94 2.37 1.94 19.54 32 4.05 2.50 1.93 19.53 64 4.02 2.49 1.91 19.60 128 4.03 2.49 1.93 20.38 256 4.05 2.49 1.97 21.14 512 4.08 2.49 2.03 21.69 1024 4.39 2.78 2.16 25.53 2048 4.90 3.16 2.52 31.11 4096 5.71 3.82 3.09 38.93 8192 7.36 5.05 4.28 46.01 16384 12.90 9.47 8.42 59.23 32768 17.01 12.45 11.11 58.94 65536 43.46 21.01 19.18 0.00 131072 67.37 32.36 29.58 0.00 262144 108.59 54.51 50.05 0.00 524288 191.48 99.30 91.50 0.00 1048576 359.34 187.40 173.14 0.69 # OSU MPI Non-blocking All-to-All Latency Test v5.3.2 # Overall = Coll. Init + Compute + MPI_Test + MPI_Wait # Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%) 1 8.98 5.03 4.13 4.26 2 8.08 4.52 3.68 3.30 4 7.36 4.13 3.42 5.70 8 6.91 3.88 3.16 3.98 16 8.33 4.61 3.86 3.42 32 8.39 4.67 3.87 3.70 64 8.37 4.66 3.87 4.06 128 8.37 4.65 3.91 5.08 256 8.45 4.65 3.94 3.78 512 8.82 4.88 4.09 3.72 1024 9.26 5.17 4.32 5.36 2048 9.85 5.41 4.70 5.32 4096 11.78 6.46 5.63 5.39 8192 15.88 8.54 7.40 0.73 16384 26.99 15.19 13.65 13.58 32768 37.58 20.65 18.72 9.57 65536 86.77 45.13 41.30 0.00 131072 133.07 68.04 61.37 0.00 262144 209.39 110.68 101.82 3.07 524288 350.79 183.35 168.99 0.92 1048576 657.70 348.62 321.68 3.92 # OSU MPI Non-blocking Barrier Latency Test v5.3.2 # Overall = Coll. Init + Compute + MPI_Test + MPI_Wait Overall(us) Compute(us) Pure Comm.(us) Overlap(%) 9.12 4.82 4.02 0.00 # OSU MPI Non-blocking Gather Latency Test v5.3.2 # Overall = Coll. Init + Compute + MPI_Test + MPI_Wait # Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%) 1 4.77 2.82 2.17 10.53 2 4.23 2.44 2.00 10.75 4 4.20 2.52 1.90 11.41 8 3.77 2.19 1.78 11.67 16 5.87 3.61 3.03 25.10 32 5.86 3.60 3.02 24.97 64 5.85 3.60 3.03 25.62 128 5.86 3.60 3.03 25.27 256 5.90 3.80 3.09 32.01 512 6.34 3.92 3.20 24.57 1024 6.34 3.94 3.30 27.05 2048 6.97 4.23 3.55 22.98 4096 8.02 4.92 4.27 27.33 8192 10.68 6.50 5.64 25.89 16384 18.25 11.08 9.87 27.32 32768 28.55 15.65 14.12 8.64 65536 63.08 31.32 28.55 0.00 131072 97.46 48.28 44.18 0.00 262144 163.44 79.39 73.00 0.00 524288 290.30 141.19 130.05 0.00 1048576 541.64 265.15 244.45 0.00 # OSU MPI Non-blocking Scatter Latency Test v5.3.2 # Overall = Coll. Init + Compute + MPI_Test + MPI_Wait # Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%) 1 5.82 3.18 2.37 0.00 2 5.39 2.86 2.15 0.00 4 4.70 2.54 2.01 0.00 8 4.55 2.53 1.91 0.00 16 7.67 4.39 3.63 9.55 32 7.64 4.25 3.56 4.55 64 7.67 4.41 3.62 9.92 128 7.66 4.25 3.57 4.30 256 7.73 4.40 3.63 8.18 512 7.80 4.39 3.71 8.36 1024 8.06 4.46 3.94 8.53 2048 9.29 5.25 4.51 10.58 4096 10.92 6.35 5.46 16.45 8192 13.94 8.25 7.33 22.31 16384 26.16 15.59 13.98 24.41 32768 40.44 25.56 23.21 35.90 65536 75.48 34.26 31.27 0.00 131072 108.86 49.32 45.22 0.00 262144 179.69 82.26 74.39 0.00 524288 290.39 131.84 121.39 0.00 1048576 527.10 239.24 220.42 0.00 # OSU MPI Non-blocking Scatterv Latency Test v5.3.2 # Overall = Coll. Init + Compute + MPI_Test + MPI_Wait # Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%) 1 4.02 2.25 1.74 0.00 2 3.84 2.19 1.54 0.00 4 3.73 2.19 1.47 0.00 8 3.25 1.81 1.36 0.00 16 4.15 2.52 1.94 15.80 32 4.10 2.53 1.87 15.86 64 3.93 2.37 1.85 15.58 128 3.95 2.38 1.87 16.33 256 4.12 2.53 1.90 16.62 512 4.19 2.56 2.02 19.37 1024 4.42 2.72 2.20 22.91 2048 5.06 3.24 2.65 31.44 4096 6.00 3.96 3.36 39.29 8192 8.05 5.44 4.70 44.57 16384 14.89 10.91 9.69 58.89 32768 20.31 14.88 13.41 59.45 65536 53.87 26.20 23.89 0.00 131072 87.87 43.06 39.44 0.00 262144 158.78 81.31 74.75 0.00 524288 288.33 149.11 137.39 0.00 1048576 538.89 281.47 259.65 0.86 # OSU MPI Non-blocking Gatherv Latency Test v5.3.2 # Overall = Coll. Init + Compute + MPI_Test + MPI_Wait # Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%) 1 4.37 2.54 1.99 7.76 2 4.10 2.39 1.83 6.00 4 3.97 2.34 1.77 8.06 8 3.74 2.23 1.68 9.89 16 5.67 3.35 2.79 16.70 32 5.74 3.38 2.72 13.23 64 5.73 3.37 2.71 12.94 128 5.72 3.37 2.72 13.56 256 5.76 3.39 2.78 14.75 512 5.83 3.40 2.87 15.10 1024 5.92 3.76 3.05 29.30 2048 6.61 3.92 3.30 18.34 4096 7.72 4.66 3.92 21.93 8192 9.86 6.04 5.20 26.53 16384 15.74 10.30 9.18 40.74 32768 23.47 13.96 12.53 24.11 65536 49.56 25.44 23.18 0.00 131072 83.11 42.67 39.04 0.00 262144 158.60 84.61 77.76 4.85 524288 289.63 147.72 136.11 0.00 1048576 548.27 284.19 262.21 0.00 # OSU MPI Non-blocking Allgatherv Latency Test v5.3.2 # Overall = Coll. Init + Compute + MPI_Test + MPI_Wait # Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%) 1 9.67 5.52 4.55 8.65 2 8.81 4.98 4.09 6.11 4 7.90 4.43 3.78 8.13 8 7.46 4.19 3.53 7.43 16 11.10 6.07 5.34 5.82 32 11.14 6.07 5.37 5.58 64 11.16 6.08 5.36 5.29 128 11.39 6.28 5.40 5.48 256 11.66 6.48 5.58 7.08 512 11.88 6.57 5.75 7.65 1024 12.53 6.97 6.07 8.43 2048 14.77 7.97 6.93 1.93 4096 18.03 10.15 9.04 12.73 8192 24.55 13.41 12.07 7.73 16384 47.27 26.33 23.97 12.68 32768 51.40 28.77 26.15 13.45 65536 89.42 46.28 42.46 0.00 131072 131.23 67.99 62.38 0.00 262144 209.22 107.15 98.59 0.00 524288 365.93 188.12 173.39 0.00 1048576 675.64 345.50 318.86 0.00 # OSU MPI Non-blocking All-to-Allv Personalized Exchange Latency Test v5.3.2 # Overall = Coll. Init + Compute + MPI_Test + MPI_Wait # Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%) 1 8.70 4.87 4.02 4.78 2 7.73 4.24 3.57 2.01 4 7.20 4.01 3.31 3.47 8 7.01 3.93 3.18 2.89 16 8.44 4.57 3.83 0.00 32 8.45 4.58 3.84 0.00 64 8.43 4.58 3.82 0.00 128 8.42 4.57 3.85 0.06 256 8.46 4.58 3.89 0.29 512 8.98 4.82 4.00 0.00 1024 9.31 5.11 4.24 1.06 2048 10.10 5.52 4.74 3.43 4096 11.92 6.56 5.66 5.35 8192 15.77 8.48 7.36 0.89 16384 26.58 14.91 13.41 13.01 32768 42.23 25.08 22.79 24.74 65536 63.66 33.47 30.60 1.34 131072 104.57 53.22 48.71 0.00 262144 185.58 95.60 87.96 0.00 524288 345.72 176.48 162.59 0.00 1048576 664.22 341.37 314.91 0.00 # OSU MPI Non-blocking All-to-Allv Personalized Exchange Latency Test v5.3.2 # Overall = Coll. Init + Compute + MPI_Test + MPI_Wait # Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%) 1 8.49 4.71 3.86 1.99 2 7.59 4.23 3.50 3.97 4 7.10 3.97 3.21 2.56 8 7.03 3.95 3.16 2.77 16 8.32 4.60 3.87 3.73 32 8.33 4.60 3.86 3.37 64 8.31 4.59 3.87 4.01 128 8.32 4.60 3.90 4.63 256 8.49 4.69 3.99 4.65 512 8.89 4.77 4.09 0.00 1024 9.84 5.63 4.80 12.22 2048 9.92 5.48 4.72 6.07 4096 13.03 7.15 6.01 2.13 8192 15.36 8.40 7.41 6.12 16384 26.51 14.97 13.43 14.04 32768 37.46 20.49 18.55 8.48 65536 64.11 33.99 31.03 2.92 131072 104.27 53.28 48.93 0.00 262144 191.08 97.07 89.33 0.00 524288 349.56 177.71 163.71 0.00 1048576 668.54 341.83 315.28 0.00 Running one-sided benchmarks # OSU MPI_Accumulate latency Test v5.3.2 # Window creation: MPI_Win_allocate # Synchronization: MPI_Win_flush # Size Latency (us) 0 0.13 1 3.20 2 2.94 4 2.79 8 2.79 16 3.00 32 3.01 64 3.01 128 3.09 256 3.15 512 3.20 1024 3.41 2048 3.79 4096 4.61 8192 6.49 16384 14.35 32768 17.82 65536 31.23 131072 45.16 262144 69.82 524288 102.12 1048576 168.01 2097152 327.56 4194304 646.55 # OSU MPI_Get Bandwidth Test v5.3.2 # Window creation: MPI_Win_allocate # Synchronization: MPI_Win_flush # Size Bandwidth (MB/s) 1 1.04 2 2.11 4 4.98 8 11.22 16 22.24 32 44.38 64 88.46 128 174.72 256 332.85 512 651.00 1024 1163.56 2048 2005.24 4096 3005.52 8192 4111.39 16384 1252.81 32768 2305.26 65536 4434.19 131072 6565.88 262144 8563.04 524288 10118.59 1048576 11134.44 2097152 11739.62 4194304 12051.03 # OSU MPI_Get latency Test v5.3.2 # Window creation: MPI_Win_allocate # Synchronization: MPI_Win_flush # Size Latency (us) 0 0.12 1 3.20 2 2.93 4 2.78 8 2.77 16 2.79 32 2.79 64 2.79 128 2.90 256 2.88 512 3.08 1024 3.18 2048 3.49 4096 4.21 8192 5.72 16384 18.61 32768 27.32 65536 34.25 131072 34.66 262144 48.62 524288 72.31 1048576 113.99 2097152 193.85 4194304 369.78 # OSU MPI_Put Bi-directional Bandwidth Test v5.3.2 # Window creation: MPI_Win_allocate # Synchronization: MPI_Win_post/start/complete/wait # Size Bandwidth (MB/s) 1 0.98 2 2.47 4 4.87 8 9.11 16 17.42 32 34.07 64 68.50 128 135.12 256 263.11 512 511.47 1024 952.18 2048 1673.45 4096 2673.99 8192 3702.37 16384 3781.53 32768 4274.17 65536 8647.78 131072 12573.63 262144 15881.72 524288 18480.32 1048576 8683.62 2097152 9424.10 4194304 9700.52 # OSU MPI_Put Bandwidth Test v5.3.2 # Window creation: MPI_Win_allocate # Synchronization: MPI_Win_flush # Size Bandwidth (MB/s) 1 1.05 2 2.17 4 5.05 8 11.60 16 22.30 32 44.00 64 87.11 128 173.93 256 342.17 512 671.07 1024 1261.03 2048 2181.58 4096 3306.91 8192 4285.24 16384 2569.05 32768 3717.29 65536 8002.75 131072 11376.71 262144 11895.72 524288 12088.77 1048576 5781.87 2097152 6907.11 4194304 7476.38 # OSU MPI_Put Latency Test v5.3.2 # Window creation: MPI_Win_allocate # Synchronization: MPI_Win_flush # Size Latency (us) 0 0.12 1 3.15 2 2.87 4 2.75 8 2.75 16 2.84 32 2.86 64 2.86 128 2.97 256 2.95 512 3.10 1024 3.24 2048 3.57 4096 4.30 8192 5.82 16384 12.37 32768 14.37 65536 26.41 131072 33.41 262144 47.49 524288 65.71 1048576 107.76 2097152 192.39 4194304 360.11 # OSU MPI_Get_accumulate latency Test v5.3.2 # Window creation: MPI_Win_allocate # Synchronization: MPI_Win_flush # Size Latency (us) 0 0.13 1 3.20 2 2.92 4 2.87 8 2.87 16 3.17 32 3.19 64 3.25 128 3.30 256 3.38 512 3.61 1024 4.06 2048 4.90 4096 6.73 8192 10.20 16384 26.40 32768 34.31 65536 57.91 131072 83.10 262144 129.81 524288 183.81 1048576 284.78 2097152 521.64 4194304 941.34 # OSU MPI_Fetch_and_op latency Test v5.3.2 # Window creation: MPI_Win_allocate # Synchronization: MPI_Win_flush # Size Latency (us) 8 3.37 # OSU MPI_Compare_and_swap latency Test v5.3.2 # Window creation: MPI_Win_allocate # Synchronization: MPI_Win_flush # Size Latency (us) 8 3.23