System test with robot framework #8481
michaelDCurran
merged
101 commits into
master
from
systemTestWithRobot
WIP prototype sysTest
f868f5f7
WIP include flaky way of exiting
e9a2af7c
WIP System testing
1fb27cbb
Merge branch 'master' into systemTestWithRobot
584ea967
First try at including system tests in appveyor.
5c831246
Disable pyAutoGUI's failsafe check as appeyor moves the mouse???
dd9f3e77
Merge branch 'systemTestWithRobot' into appveyorTests
5a75207b
initial.robot: break robot to temporarily bipass freeze.
1e6e265c
appveyor.yaml: run robot in powershell so exit code is ignored for now.
69f4407a
appveyor.yaml: try again to make system tests return error code 0
9bd9760e
appveyor.yaml: try again to make system tests return error code 0
488a33e8
appveyor.yaml: fix syntax of uplodFile.
f2758719
system tests: tell appVeyor they are junit formatted?
9b889f80
appVeyor: still upload test results on failed builds.
c3b4a904
Upload unitTest reports to appViewer as well.
8b0e1c26
Investigate freeze in robot test.
9270a20c
add some logging to nvdaRobotLib
30a12566
More logging
8e02fc4b
more logging again
38248879
sleep before connecting to server.
e244bcb6
more and more logging
1c4f7b97
Fix logging...
d80c6883
reimplement quit nvda test inside initial.robot.
5e130c05
A try at moving everying to robot language to fix freezes.
bdb51dae
Launch NVDA from robot with py for appveyor.
12867827
copy the globalPlugin.
a57e95e9
Temporarily start rdp for appveyor build
5d540e70
bump
8195ee41
bump 2
6e530b6d
bump 3
38e696ba
bump 4
2274ea67
Slightly re-write now with setup and teardown, and insert q for quit …
d8cd6189
nvdaRobotLib: use a specific NVDA profile dir.
d6acae57
NVDA Spy for robot must use a daemon thread for now to stop further …
5c55400e
Robot tests set NVDA not to show the welcome dialog
06aa06b1
allow asserting on last speech
ce75aa0f
Merge remote-tracking branch 'origin/robotOnAppveyor' into systemTest…
0c16f1b5
Remove extra tab characters
735991aa
Copy in the testSpy globalPlugin for each test.
662eabbd
Remove sleep
08c86976
Some cleanup of connection/disconnection code
89816971
Extract code that can be reused and add better documentation
669da0a8
cleanup systemTest dir
2bc38042
Assert text on welcome dialog passes
6d2032a9
Copy nvda log for each test
b0477e8e
Try to get systemtest artefacts from appveyor
4f9149e2
Try manually pushing artifacts
36e7ee8f
Try recursing over files and pushing manually
e6a6fbf8
Fix issue when nvdaProfile folders do not exist
4787753a
system tests: don't show usage stats dialog in NVDA
e9f21892
appveyor: install NVDA on the build system, and run the system tests …
53219530
appveyor: install nvda with start-process and wait up to 3 minutes fo…
13b53972
fix appveyor errors
66b0005a
Temprarily include robotremoteserver in NVDA for system tests. Must f…
6600242a
Breakup up appveyor test code into separate powershell code chunks to…
d02fe756
system tests: use silence synth driver.
c9856774
Merge master
a32f1aa4
system test for exit dialog: just sleep instead of varifying dialog.
5c4d2846
system tests: don't wait for exit dialog, rather just confirm that th…
844c73b7
appveyor: move NVDA installation to before_test section.
78432cf4
ensure quit system test: exit from the NVDA menu.
221208e0
system tests: try alt tabbing to the exit dialog???
7bd259ad
More debugging for system tests.
6a757e1c
IAccessibleHandler: more debugging.
6edf1e03
IAccessibleHandler: more debugging.
167b362a
eventHandler: more debugging.
27446cfd
Up max foreground defer count to 10.
ce6474a8
Up foreground defers to 100 and log them.
86aeb069
IAccessibleHandler: drop foreground defers back down and allow welco…
8bfbf746
system tests for quit with keyboard: watch for and close welcome dial…
80276820
quit with keyboard system test: wait longer for NVDA to exit.
2913125b
Restore IAccessibleHandler and eventHandler.
e6e81882
Not able to get an index returned from get_index_of_speech
9fd13f43
tests passing
52853fcf
move spy lib logic into spy
da0df66a
Install systemTestSpy as a package on setup
bc869e6f
Cleanup files, add copyright headers
f20dc359
Use _ to prevent imports from leaking as keywords
612659dc
Move non NVDA specific helpers into a new library
52663016
Merge remote-tracking branch 'origin/installed_systemTestWithRobot' i…
e3ae2a1a
Create self contained package for system test spy
fd673833
Zip system test output before pushing to artifacts
f1be08f5
try adding robotlibraries directory to the path
da14b4be
Fix case of file name
6818faa8
further tidy up
39f6b07a
Introduce suite name
50137bc4
fix appveyor system tests
cbf6c7e0
Stop double nvda install log artifact
385e8ead
set robot library path
df023776
reduce suite verbosity on appveyor
44d94fd7
Revert to running from repo root
25f18979
Clean up some of the appveyor code
9254b1ec
clean up some names and docs for tests
edb0e75e
Add scons command to run system tests
7bd629ef
ensure dir is created for std out/err logs
21146643
Merge remote-tracking branch 'origin/master' into systemTestWithRobot
46cfaae5
Use dummy speech synth to get speech
f8606bcc
wait longer before sending input
c8b91998
Stop update dialog from showing on startup
0e743acb
simplify the appveyor pip installs
21eca3c7
derekriemer
dismissed these changes
on 2018-07-07
michaelDCurran
dismissed these changes
on 2018-07-17
Update What's new
be440a96
michaelDCurran
approved these changes
on 2018-07-17
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
Login to write a write a comment.
Login via GitHub