Changes between Version 10 and Version 11 of WindowsTesting


Ignore:
Timestamp:
10/17/16 07:00:10 (2 years ago)
Author:
Samuli Seppänen
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • WindowsTesting

    v10 v11  
    88= Current test scripts =
    99
    10 * [https://github.com/mattock/openvpn-windows-buildtest openvpn-windows-buildtest] bash scripts
     10* [https://github.com/mattock/openvpn-windows-buildtest openvpn-windows-buildtest bash scripts]
    1111 * Builds an installer on every commit to "release/2.3" and "master" branches
     12 * Uses [https://github.com/OpenVPN/openvpn-build openvpn-build]
    1213 * Publishes the resulting installers
    13  * Email select developers on build failure
    14 * [https://github.com/mattock/openvpn-windows-test openvpn-windows-test] Powershell scripts
    15  * Automated, manually-triggered testing of OpenVPN-GUI, openvpnserv2 and "OpenVPN in cmd.exe"
     14 * Emails selected developers on build failure
     15* [https://github.com/mattock/openvpn-windows-test openvpn-windows-test Powershell scripts]
     16 * Automated, manually-triggered testing of OpenVPN-GUI, openvpnserv2 and "OpenVPN inside cmd.exe"
    1617 * Tests are done with arbitrary OpenVPN servers (whatever in the configuration directory)
    1718* ''run.bat/run2.bat'' from cron2 (unpublished atm)
     
    2223== GUI-based usage (OpenVPN-GUI) ==
    2324
    24 All the basic functionality of [https://github.com/OpenVPN/openvpn-gui OpenVPN GUI] should be tested. Connectivity tests have been automated with the [https://github.com/mattock/openvpn-windows-test openvpn-windows-test] Powershell script.
     25All the basic functionality of [https://github.com/OpenVPN/openvpn-gui OpenVPN GUI] should be tested. Connectivity tests have been automated with the [https://github.com/mattock/openvpn-windows-test openvpn-windows-test].
    2526
    2627[https://github.com/OpenVPN/openvpn-gui OpenVPN-GUI] communicates with OpenVPN using the management interface, as do all the more recent GUIs. Thus management interface tests (below) will eventually help verify correct operation of OpenVPN-GUI. All the basic functions of OpenVPN-GUI should be tested, but how would these tests be automated? Would it require an automation API in OpenVPN-GUI itself?
     
    2829== OpenVPN as a service (openvpnserv2) ==
    2930
    30 All the basic functionality of [https://github.com/OpenVPN/openvpnserv2 openvpnserv2] should be tested. Connectivity tests have been automated with the [https://github.com/mattock/openvpn-windows-test openvpn-windows-test] Powershell script.
     31All the basic functionality of [https://github.com/OpenVPN/openvpnserv2 openvpnserv2] should be tested. Connectivity tests have been automated with the [https://github.com/mattock/openvpn-windows-test openvpn-windows-test].
    3132
    3233More advanced tests yet to be automated:
     
    4243
    4344* cron2's run.bat/run2.bat script
    44 * [https://github.com/mattock/openvpn-windows-test openvpn-windows-test] Powershell script
     45* [https://github.com/mattock/openvpn-windows-test openvpn-windows-test]
    4546
    4647Other things that should be tested:
     
    6970= Management interface =
    7071
    71 Ensure that management interface commands work as expected, with particular focus on the commands and sequences that a GUI typically uses. These tests should automated immediately. Questions:
     72Ensure that management interface commands work as expected, with particular focus on the commands and sequences that a GUI typically uses. These tests should not be run manually, but rather automated directly. Questions:
    7273
    7374* How do we automate the tests?
    7475* What are the commands and sequences we should test?
    7576
    76 Right now there are no tests, not even ones that are run manually.
    77 
    7877= Basic connectivity testing =
    7978
    80 Extend t_client.sh tests to Windows also.  Right now: barebones run.bat+run2.bat and [https://github.com/mattock/openvpn-windows-test openvpn-windows-test] Powershell script.
     79Extend t_client.sh tests to Windows also.  Right now: barebones run.bat+run2.bat (see above) and [https://github.com/mattock/openvpn-windows-test openvpn-windows-test].
    8180
    8281= Infrastructure needed for the tests =