PR #3537 Merge end-to-end tests

add support for passing chrome path as env var

edf37e35

make scripts executable, running them with sh does something weird on…

c3b7e6c7

exit on error

e8f626ba

remove test exit, and use port we are semi-sure is free

976f041b

show browser logs on error

5cd52e2e

dont fail when trying to stop riot and its not running

758da786

stop servers on error in run script

29d68854

log all requests with their response code

5129bb57

only allow one riot server instance simultaneously

31fcf08f

apply config file when starting riot, not installing, so we can suppo…

e50420dd

output document html on error and dont make a screenshot on submit

a5c89114

try upgrading puppeteer

d738b404

no need to log contents of zip files

c357a015

xhr and console logs are done for all tests now, no need to do it in …

9a2f3094

log when using external chrome!

38765772

dont swallow riot server errors

f57628e3

dont swallow synapse startup errors

97fa7e03

Merge pull request #3 from matrix-org/bwindels/ci_script

1b01867b

create session object to scope a user, move helper methods there

7c91ecab

move log buffers into session, start logging implicitely

6b843eac

move outputting steps to session to scope it to username

4c0ab117

create second user and join room first user creates

5fe38611

move step logging to tests, DRY; put test scenario in separate file, …

4e7df212

more consistent naming on session methods

aaa5ee1a

no need to double select here, might speed things up slightly

2a7438e9

run synapse on custom port so it doesn't interfere with other synapse…

643af2d3

add support for changing the room settings

a78c095c

wait to receive message from other user

1fd379b3

make receiving a bit more robust

c5f064e3

prepare for more tests

73c88fe6

avoid typos

dc87e2bf

add test scenario for e2e encryption

af0c0c0a

fix composer issue and more

2c983f8c

Merge pull request #4 from matrix-org/bwindels/2usersjoin

4c3386a2

Merge pull request #6 from matrix-org/bwindels/e2erooms

a54f13cd

bring indentation in line with other front-end projects

377a20ff

Merge pull request #8 from matrix-org/bwindels/indentation

95668823

add argument for passing riot server, makes local testing easier

8507cf82

didnt mean to commit this

0e56250b

increase timeout

4f76ad83

Merge pull request #10 from matrix-org/bwindels/increasetimeout

26e4645a

increase receive message timeout

440b1032

Merge pull request #11 from matrix-org/bwindels/increasetimeout2

c49f1b33

Merge pull request #9 from matrix-org/bwindels/commander

1e0baa82

increase timeouts so the tests dont timeout on build server

fd67ace0

remove specific timeout for selectors

f49b8589

dont assume new target is a new page

6be59750

encryption dialogs dont always appear coming back from settings... weird

a65d6af8

commander inverts the meaning of program args by itself ... nice, I g…

2321e43f

Merge pull request #12 from matrix-org/bwindels/fixbuild

3e8b55b4

add rest/non-browser session, which we can create a lot more off

98aafd6a

pass rest session creator to scenario

afc678fe

support setting the display name on rest session

3c5e73d6

creator instead of factory, as it does registration and authentication

48d95c22

add wrapper around multiple rest sessions

827e6365

Merge branch 'master' into bwindels/lltests

40577109

wait for the message to be sent

4a4b1f65

support setting the room alias

be4c1cb8

allow clients to send messages faster, in order to speed up the test

2be413ba

support joining with a room alias for rest session

ff20bc78

join use cases that touch settings in one file, as selectors are similar

abc7c4c3

past rest creator to scenario to also be able to call createSessionRange

3db32c93

WIP for LL test

dcf96e14

dont show all 20 send messages

244d5b08

implement reading and scrolling timeline, group timeline related code

249cf4f8

store displayName on RestSession to use it in tests

4057ec8a

finish basic LL test to see if display names appear from lazy loaded …

29aec256

increase timeout here in case this wouldnt be enough for the CI server

7bcb255a

these changes were not needed in the end

e843d532

structure flags better and document them

c8fec947

move Logger and LogBuffer to own module

5745e9ed

move range and delay over to util module

923ae905

rename tests folder to the more accurate usecases

5ec8f6f9

split up scenarios in multiple files as lazy-loading scenarios grow

1725e752

split up ll tests in several functions

5d06c65c

add ll tests to check if all expected members are in memberlist

239e6a4b

make receiveMessage more robust by checking first if the message is n…

9f4cf776

dont assert the first time in receiveMessage, as it will show an ugly…

af255c63

add logging to rest session actions

6deb595f

Test if members joining while user is offline are received after retu…

16b2f099

Merge pull request #17 from matrix-org/bwindels/flagsandreadme

58d52f9c

wait for next sync before inspecting memberlist

36708cc5

DRY usernames

992a0be4

use develop for now as LL with gappy syncs is fixed on that branch fo…

8cff961e

Merge pull request #16 from matrix-org/bwindels/lltests

5e8a3db9

Merge pull request #19 from matrix-org/bwindels/lltests2

320e39bd

Merge branch 'master' into bwindels/lltests3

1906661e

Merge pull request #22 from matrix-org/bwindels/lltests3

f26c50cd

spit out logs for creating REST users to figure out what is going on …

42c1b95b

Merge pull request #23 from matrix-org/bwindels/restlogs

3de9f6ef

increase timeout for server notices room

0d86b82e

Merge pull request #24 from matrix-org/bwindels/increaseservernoticet…

d1d88650

use patched synapse so admin rest api works with python 2.7.6

a84162ed

Merge pull request #25 from matrix-org/bwindels/fixadminapiusage

1c855364

disable LL tests on travis CI

cf397efe

Revert "increase timeout for server notices room"

d47f782c

Merge pull request #27 from matrix-org/revert-24-bwindels/increaseser…

6e972152

Revert "use patched synapse so admin rest api works with python 2.7.6"

70eb4805

Merge pull request #28 from matrix-org/revert-25-bwindels/fixadminapi…

fec1447e

pass parameters through instead of hardcoding --travis

13b20bb1

Merge pull request #26 from matrix-org/bwindels/disablelltests

64608af0

set a room alias for a public room, as required now

a637ad85

Merge pull request #29 from matrix-org/bwindels/fixroomaliasrequirements

4aad156b

current tests need riot develop to set a room alias without a domain …

8ee7623d

Some changes to make the testing script run on mac, too, + a multithr…

04b64dba

Make the sed usage cross-platform compatible

861af622

list of tests we want to write

1147508c

Merge pull request #31 from matrix-org/bwindels/lltestsonlyrunondevelop

a1cd2aeb

add config file instructions to run with --riot-url

b2bd1349

test leaving members disappear from memberlist

1a225467

Fix the registration process to handle m.login.terms auth

f607cb27

There is no more server notices invite on signup

d57a56d7

Merge pull request #39 from matrix-org/travis/fix-consent

daa96244

Tell synapse to require consent at registration

1a0f0954

Merge pull request #41 from matrix-org/travis/fix-consent-register

25597860

Click the 'Accept' button as part of the signup process

2e839d54

Merge pull request #42 from matrix-org/travis/fix-consent-signup

259d4d62

Install jinja2

19c4f4a8

Merge pull request #43 from matrix-org/travis/fix-build

8f554556

adjust synapse install script for python3 and config file changes

7ac19b0b

use yarn and update dependencies, commit lock file

3056d936

fix signup

ab5a2452

fix creating a room

65ca1b33

fix changing the room settings

a27b92a4

fix joining a room through the room directory

fe6a273b

fix writing in composer

5598214c

missed this when making createRoom export non-default earlier

a1505971

fix enabling e2e encryption in room settings

2bf51da7

fix inviting someone

ae5dc9d0

fix verification, replace device id/key with SAS verification.

9ab16925

fix detecting e2e message in timeline

28bba495

doing wait for /sync request to receive message, doesn't work well

34171eab

fix import

c1312f09

lazy loading is not in labs anymore

f197e9f9

remove travis flag

450430d6

"disable" rate limiting for rest users

2449ddcf

fix gete2e info and open settings, even though not used currently

d63a0c5a

this dialog isn't shown anymore and this was accepting the SAS dialog

e147cc93

nicer output, comment

e10e4b0e

forgot to add consent listener again, this will fix REST registration

2b2a4867

fix scrollpanel selector

5939d624

section for creating rest users

3affb8f0

Merge pull request #36 from matrix-org/bwindels/checkleavesmemberlist

240c715c

Merge branch 'master' into bwindels/redesignfixes

ed772e2c

use shorter .bak suffix approach

9c41ccce

Merge branch 'master' into toml/install-scripts-fail-fast

c1464aaa

Merge pull request #32 from matrix-org/toml/install-scripts-fail-fast

68528515

Merge branch 'master' into bwindels/redesignfixes

2228ba83

use yarn

5d4ded05

keep complexhttpserver installation within riot folder and gitignore …

146549a6

use python3 to install riot webserver

d93e6edb

PR feedback

04e06c3c

Merge pull request #46 from matrix-org/bwindels/redesignfixes

58e6d1bf

install ComplexHttpServer regardless of whether riot is already insta…

cfff4a99

c/p error

4e1ddf85

pass --no-sandbox to puppeteer

53eab479

moar sandbox flags

7e2d35fd

support writing logs to file

492d8106

Merge pull request #47 from matrix-org/bwindels/logstofile

bdd7191c

avoid ipv6, see if that makes buildkite happy

d1df0d98

show all of create rest user command output on failure

4591b26d

show browser version when running tests

b88dc0ff

better error handling when creating rest user fails

4c79e3bd

dont assume bash when creating rest users

7fbfe315

rest users dont need to be admin

200f95b3

test upload artefacts on failure

d978ce6b

write html, console and network logs to different files

6958fdb6

add screenshots to logs directory upon failure

f55a4487

remove debug error

b0fb36db

fix broken selector

be324142

wait longer to arrive at #home but poll every 100ms

b01e1264

increase dialog timeout a bit

f489f55f

log messages in timeline when expected not found (debug code)

945daf29

take into account continuation tiles in when checking timeline messages

9610e9b5

use session.poll as well for polling when receiving a message

20c3023b

wait for opponent label to appear in sas dialog

ee46c2b0

poll these as well as ci is slowwww

ef59c59f

add flag to throttle cpu to get failures because of slow ci locally

c40f7f6a

remove explicit timeouts from tests for selectors

48c1d46a

update readme

eae830a4

remove explicit timeout for polling as well

ee1e5853

Update TODO.md

bf029660

adjust selectors for join and accept button in room preview bar

20d80e69

Merge pull request #48 from matrix-org/bwindels/stylepreviewbar

370741fc

Only install the minimum deps to pass

2527995e

Report location of Synpase log

1ffe0d1a

Use a stronger password

f82f9ecd

Wait for password validation

3e6719e8

install synapse/develop (and deps) from pip

7a15acf2

generate signing keys without generating config file and then overwr. it

894a0748

Merge pull request #50 from matrix-org/bwindels/fixsynapseinstallation

26f9dd07

adjust path to register script for pip installation

d9def181

Merge pull request #51 from matrix-org/bwindels/fixsynapseinstallation2

c76dc874

look for activate in cwd

a7293455

Merge pull request #52 from matrix-org/bwindels/fixsynapseinstallation3

6b6de05c

Bump lodash from 4.17.11 to 4.17.15

8a247e0e

Merge pull request #54 from matrix-org/dependabot/npm_and_yarn/lodash…

6414ac9f

Adjust tests for hidden IS field

7635e938

Merge pull request #55 from matrix-org/jryans/hide-is-field-during-auth

a3abde58

Fix signup: set custom hs through advanced section, and accept IS step

67b03b5a

Adjust how room directory and create room dialog should be opened

f66f5bed

Merge pull request #56 from matrix-org/bwindels/fix-signup

b8b2ef26

Revert "Fix signup: set custom hs through advanced section, and accep…

16591719

Merge pull request #58 from matrix-org/revert-56-bwindels/fix-signup

ad10148e

Merge pull request #57 from matrix-org/bwindels/fix-open-directory

e3f7246c

find new join button in room directory

f2a3a136

Merge pull request #59 from matrix-org/bwindels/fix-roomdirectory-join

7be47b27

retry getting the scroll panel when retrying to get the scrolltop

a25056f2

try to fix selecting all text in Field components

87be5fb9

Revert "Revert "Fix signup: set custom hs through advanced section, a…

c36673b9

Merge pull request #60 from matrix-org/bwindels/somefixes

04f75140

Merge pull request #61 from matrix-org/revert-58-revert-56-bwindels/f…

5f03854f

only need 2 clicks, not 3

1ea50476

Merge pull request #62 from matrix-org/bwindels/morecustomhsregisterfix

912a9747

look for a change (HS) link in the registration but don't fail if its…

06af5b3f

Merge pull request #63 from matrix-org/bwindels/optionalchangelink

9694dcda

adjust create room dialog name field selector

03d928bf

Merge pull request #64 from matrix-org/bwindels/createroomadjustments

7d1cb437

unbreak tests; we no longer prompt for IS at register

fe1b786c

unbreak tests (take 2); we no longer prompt for IS at register

f5b605be

use correct css class for cider composer

5b71cf5d

remove editorconfig

6cb9ef7e

move everything to subfolder to merge into react-sdk

ca86969f

Merge remote-tracking branch 'e2etests/bwindels/bigmerge' into bwinde…

ae38e0b3

only run riot static server if no riot url has been provided

cad71913

first attempt at running local e2e tests from CI

5b9bfae3

Merge remote-tracking branch 'e2etests/bwindels/use-cider' into bwind…

de21cb24

don't fetch riot/master by default when installing e2e tests

59cc36ca

make e2e test safe to run from anywhere

f8358fa4

warn if not installed yet when running e2e tests

ebc2bba0

provide yarn command to run e2e tests

3e971e48

fix lint

2d848bba

bwindels force pushed from 465e07e4 to 2d848bba 6 years ago

install static webserver for server symlinked riot on CI

645a9d83

copyright

6f960499

switch e2e tests to xlarge queue

867739e8

put exec perms back on install script

4b9a29cb

fix the lint fix

15bbf3a9

document how to run the e2e tests locally

d20b2ee9

bwindels marked this pull request as ready for review 6 years ago

bwindels requested a review 6 years ago

jryans requested changes on 2019-10-18