Browse Source

Remove fixed and flakey tests from the sytest blacklist (#10788)

We want to blacklist only known, consistent failures. We should deflake tests rather than ignoring them.
tags/v1.43.0rc1
David Robertson 2 years ago
committed by GitHub
parent
commit
c6f5fb5477
No known key found for this signature in database GPG Key ID: 4AEE18F83AFDEB23
3 changed files with 2 additions and 18 deletions
  1. +0
    -8
      .ci/worker-blacklist
  2. +1
    -0
      changelog.d/10788.misc
  3. +1
    -10
      sytest-blacklist

+ 0
- 8
.ci/worker-blacklist View File

@@ -1,10 +1,2 @@
# This file serves as a blacklist for SyTest tests that we expect will fail in
# Synapse when run under worker mode. For more details, see sytest-blacklist.

Can re-join room if re-invited

# new failures as of https://github.com/matrix-org/sytest/pull/732
Device list doesn't change if remote server is down

# https://buildkite.com/matrix-dot-org/synapse/builds/6134#6f67bf47-e234-474d-80e8-c6e1868b15c5
Server correctly handles incoming m.device_list_update

+ 1
- 0
changelog.d/10788.misc View File

@@ -0,0 +1 @@
Remove fixed and flakey tests from the sytest-blacklist.

+ 1
- 10
sytest-blacklist View File

@@ -1,5 +1,5 @@
# This file serves as a blacklist for SyTest tests that we expect will fail in
# Synapse.
# Synapse. This doesn't include flakey tests---better to deflake them instead.
#
# Each line of this file is scanned by sytest during a run and if the line
# exactly matches the name of a test, it will be marked as "expected fail",
@@ -9,9 +9,6 @@
# Test names are encouraged to have a bug accompanied with them, serving as an
# explanation for why the test has been excluded.

# Blacklisted due to https://github.com/matrix-org/synapse/issues/1679
Remote room members also see posted message events

# Blacklisted due to https://github.com/matrix-org/synapse/issues/2065
Guest users can accept invites to private rooms over federation

@@ -24,12 +21,6 @@ Newly created users see their own presence in /initialSync (SYT-34)
# Blacklisted due to https://github.com/matrix-org/synapse/issues/1396
Should reject keys claiming to belong to a different user

# Blacklisted due to https://github.com/matrix-org/synapse/issues/1531
Enabling an unknown default rule fails with 404

# Blacklisted due to https://github.com/matrix-org/synapse/issues/1663
New federated private chats get full presence information (SYN-115)

# Blacklisted due to https://github.com/matrix-org/matrix-doc/pull/2314 removing
# this requirement from the spec
Inbound federation of state requires event_id as a mandatory paramater


Loading…
Cancel
Save