Changes between Version 10 and Version 11 of WindowsTesting
- Timestamp:
- 10/17/16 07:00:10 (8 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
WindowsTesting
v10 v11 8 8 = Current test scripts = 9 9 10 * [https://github.com/mattock/openvpn-windows-buildtest openvpn-windows-buildtest ] bash scripts10 * [https://github.com/mattock/openvpn-windows-buildtest openvpn-windows-buildtest bash scripts] 11 11 * Builds an installer on every commit to "release/2.3" and "master" branches 12 * Uses [https://github.com/OpenVPN/openvpn-build openvpn-build] 12 13 * Publishes the resulting installers 13 * Email selectdevelopers on build failure14 * [https://github.com/mattock/openvpn-windows-test openvpn-windows-test ] Powershell scripts15 * Automated, manually-triggered testing of OpenVPN-GUI, openvpnserv2 and "OpenVPN in cmd.exe"14 * Emails selected developers on build failure 15 * [https://github.com/mattock/openvpn-windows-test openvpn-windows-test Powershell scripts] 16 * Automated, manually-triggered testing of OpenVPN-GUI, openvpnserv2 and "OpenVPN inside cmd.exe" 16 17 * Tests are done with arbitrary OpenVPN servers (whatever in the configuration directory) 17 18 * ''run.bat/run2.bat'' from cron2 (unpublished atm) … … 22 23 == GUI-based usage (OpenVPN-GUI) == 23 24 24 All the basic functionality of [https://github.com/OpenVPN/openvpn-gui OpenVPN GUI] should be tested. Connectivity tests have been automated with the [https://github.com/mattock/openvpn-windows-test openvpn-windows-test] Powershell script.25 All the basic functionality of [https://github.com/OpenVPN/openvpn-gui OpenVPN GUI] should be tested. Connectivity tests have been automated with the [https://github.com/mattock/openvpn-windows-test openvpn-windows-test]. 25 26 26 27 [https://github.com/OpenVPN/openvpn-gui OpenVPN-GUI] communicates with OpenVPN using the management interface, as do all the more recent GUIs. Thus management interface tests (below) will eventually help verify correct operation of OpenVPN-GUI. All the basic functions of OpenVPN-GUI should be tested, but how would these tests be automated? Would it require an automation API in OpenVPN-GUI itself? … … 28 29 == OpenVPN as a service (openvpnserv2) == 29 30 30 All the basic functionality of [https://github.com/OpenVPN/openvpnserv2 openvpnserv2] should be tested. Connectivity tests have been automated with the [https://github.com/mattock/openvpn-windows-test openvpn-windows-test] Powershell script.31 All the basic functionality of [https://github.com/OpenVPN/openvpnserv2 openvpnserv2] should be tested. Connectivity tests have been automated with the [https://github.com/mattock/openvpn-windows-test openvpn-windows-test]. 31 32 32 33 More advanced tests yet to be automated: … … 42 43 43 44 * cron2's run.bat/run2.bat script 44 * [https://github.com/mattock/openvpn-windows-test openvpn-windows-test] Powershell script45 * [https://github.com/mattock/openvpn-windows-test openvpn-windows-test] 45 46 46 47 Other things that should be tested: … … 69 70 = Management interface = 70 71 71 Ensure that management interface commands work as expected, with particular focus on the commands and sequences that a GUI typically uses. These tests should automated immediately. Questions:72 Ensure that management interface commands work as expected, with particular focus on the commands and sequences that a GUI typically uses. These tests should not be run manually, but rather automated directly. Questions: 72 73 73 74 * How do we automate the tests? 74 75 * What are the commands and sequences we should test? 75 76 76 Right now there are no tests, not even ones that are run manually.77 78 77 = Basic connectivity testing = 79 78 80 Extend t_client.sh tests to Windows also. Right now: barebones run.bat+run2.bat and [https://github.com/mattock/openvpn-windows-test openvpn-windows-test] Powershell script.79 Extend t_client.sh tests to Windows also. Right now: barebones run.bat+run2.bat (see above) and [https://github.com/mattock/openvpn-windows-test openvpn-windows-test]. 81 80 82 81 = Infrastructure needed for the tests =