Changes between Version 19 and Version 20 of PerformanceTesting


Ignore:
Timestamp:
10/28/11 13:43:12 (12 years ago)
Author:
Samuli Seppänen
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • PerformanceTesting

    v19 v20  
    4646    transfer rate remains the same? (or "non-linear resource consumption growth")
    4747
    48 Below is a list of proposed test cases. All bandwidth (BW) numbers are in MB/s (megabytes per second), as measured by ''iperf''.
    49 
    50 ||'''Test name'''||'''Min clients'''||'''Max clients'''||'''BW/client'''||'''Bandwidth rise'''||'''Description'''||'''Answer to'''||
    51 ||TP-1||1||10||100||Gradual||Few clients with high bandwidth||1,3||
    52 ||TP-2||10||100||10||Gradual||Many clients with medium bandwidth||1,3||
    53 ||TP-3||10||1000||1||Gradual||Horde of clients with low bandwidth||1,3||
     48Below is a list of test cases:
     49
     50||'''Test name'''||'''Clients'''||'''Answer to'''||
     51||MP-1||5||1,3||
     52||MP-2||20||1,3||
     53||MP-3||50||1,3||
     54||MP-4||100||1,3||
    5455
    5556Protocol needs to be UDP, as TCP (in iperf) prevents controlling throughput.
     
    8384Proposed test cases are shown below:
    8485
    85 ||'''Test name'''||'''Max clients'''||'''Description'''||'''Answer to'''||
    86 ||C-1||10||Simultaneous connection initiation||1||
    87 ||C-2||50||Simultaneous connection initiation||1,2?||
    88 ||C-3||100||Simultaneous connection initiation||1,2?||
     86||'''Test name'''||'''VM x OpenVPN instances'''||'''Answer to'''||
     87||C-1||50x2||1,2?||
     88||C-2||50x6||1,2?||
     89||C-3||50x10||1,2?||
     90
     91The least powerful instances in EC2 (e.g. m1.small) can be slowed down to a crawl fairly easily with 50-100 (real) clients. For more than 100 simultaneous connections several parallel OpenVPN processes are used on the same client instance; although the clients will fail to initialize properly, they should still stress the server in relatively realistic fashion.
    8992
    9093Number of simultaneous concurrent connections is increased until server chokes. Each test will be repeated for the following configurations:
     
    113116
    114117All EC2 instances were created to the same availability zone (us-east-1d). The setup of 100 client instances took ~4 minutes with 34 threads running Fabric (~3 runs per thread).
     118
     119== 15-mp4-m1.small-openvpn221 ==
     120
     121'''Connection establishment
    115122
    116123= Test environments =