Commit graph

30 commits

Author SHA1 Message Date
Ankush Menat
098a0851c6
ci: Fix coverage reporting (again) (#38849)
* chore: remove _decorate_all_methods_and_functions_with_type_checker

No one understands this runtime magic anymore.

* build: Bump coverage.py to latest

* test: Skip github in coverage reporting

* test: Print traceback from all threads when test is stuck

* ci: Enable coverage in server side tests

* ci: Always enable coverage

It's cheap in recent python versions, our reasons for selectively
disabling aren't valid anymore.

* ci: Disable stderr capturing

* ci: Use default buffer behaviour in unittest runner

* ci(coverage): Set concurrency to multiprocessing

We do use multiprocessing, perhaps the patches aren't concurrectly
handled?

* ci(coverage): Try parallel run

* fix: Apply subprocess patch

* ci: Don't start web server with coverage

Causes deadlock for some reason. We don't actually report it either.

* ci: only submit UI coverage if ran

* test: remove aggresive stuck test checking

* ci: disable UI coverage

(for now)
2026-04-24 16:05:14 +05:30
AarDG10
fe12722e4b fix(testing): use XMLTestRunner when junit_xml_output is wanted 2026-04-07 22:10:36 +05:30
Saqib Ansari
a23b1a3624 fix: disable cloud parallelization 2026-03-19 14:03:27 +05:30
Saqib Ansari
c485bacbcd fix: install cypress-split when running tests 2026-03-19 13:03:30 +05:30
ruthra kumar
8aa7de9897 refactor: support failfast on parallel test runner 2026-02-27 16:13:09 +05:30
Sagar Vora
aa8210a6fe fix: ignore warnings when running cypress 2026-01-08 13:47:12 +05:30
Sagar Vora
83f2368ccd fix: avoid package.json update during cypress install 2025-12-01 21:22:22 +05:30
sokumon
586b62da05 refactor: move auto generations of icons to a command 2025-11-14 23:05:12 +05:30
ruthra kumar
df2ab80f82
Merge pull request #33003 from ruthra-kumar/lightmode_on_parallel_test_runner
refactor: introduce lightmode in parallel test runner
2025-06-23 16:05:57 +05:30
ruthra kumar
a134b83eb8 refactor: toggle test flag in lightmode 2025-06-20 15:11:16 +05:30
ruthra kumar
ee864dac12 refactor: introduce lightmode in parallel test runner 2025-06-19 11:40:09 +05:30
ruthra kumar
7b811d0490 refactor: return code for light test runner 2025-06-05 20:10:24 +05:30
ruthra kumar
31c4bbec73 refactor: move imports to defer memory usage 2025-06-05 09:23:03 +05:30
ruthra kumar
0c6c6f50c4 refactor: support failfast and minor changes 2025-06-05 09:23:03 +05:30
ruthra kumar
0a02603cfe refactor: rename parameter and move code to function 2025-06-05 09:23:03 +05:30
ruthra kumar
4640a78587 refactor: move loader to new fiel
- barebones TestResult class
 - removed debugging statements
2025-06-05 09:23:03 +05:30
ruthra kumar
c659f9021a refactor: cleaner code with debugging statements 2025-06-05 09:23:03 +05:30
ruthra kumar
7e6b8fbf1c refactor: better code readibility 2025-06-05 09:23:03 +05:30
ruthra kumar
fcaf173923 refactor: new lightweight test runner 2025-06-05 09:23:03 +05:30
Gavin D'souza
551be4f6ab
fix: Clear site test records log before running test
Not sure if this was intentional - there is no documentation as far as i
can tell
2025-04-15 18:28:21 +02:00
Ankush Menat
13304cd36d ci: balance test distribution manually
Currently one test runner takes significantly longer than another. This
is entirely due to test_commands.py which needs to create new site and
do backup/restore tests etc. All of which are far far slower than other
tests.
2025-01-04 10:55:53 +05:30
Ankush Menat
7d4d6b59df
test: reduce noise in test output (#28862)
* chore: remove verbose output from test runner

This is same output that's shared by test runner in different format?

This makes it annoying to scroll through when just running single test
locally.

* fix: Remove clutter from test output

Test records don't change after first run.
Tests are executed many many times locally

* test: retry flaky postgres backup tests
2024-12-23 06:11:47 +00:00
David
1d31663f4b
fix(testing): clarify --pdb to --debug from a users perspective; also attach pdb on any exception
prior, the implementation attached to AssertionErrors
and the flag did not represent that this disables the buffer so that normal breakpoints work
2024-12-12 13:19:20 +01:00
David
aec58a9ad0
chore(ui-tests): raise click Exit exception 2024-11-29 13:39:03 +01:00
Akhil Narang
318a47219c
chore(ui-tests): don't print subprocess traceback
We have the cypress error from its output above, just a simple error message is enough here

Signed-off-by: Akhil Narang <me@akhilnarang.dev>
2024-11-29 18:03:18 +05:30
David Arnold
61a107b6af
ci: make gh actions functions (#28299)
* ci: make gh actions downstream reusable

* refactor: merge ci helper into run-parallel-test command

* ci: refactor to sensible db password
2024-10-27 02:09:02 +00:00
David Arnold
2f9fd308e8
fix(testing): pdb post mortem (#28156) 2024-10-17 18:52:25 +00:00
David Arnold
9d63208c9c
fix: test record generation (#28102)
* chore: improve log record of testing command invokation

* chore(testing): narrower specificacion of the persistence log

* fix(testing): append raw record source data to globalTestRecords
2024-10-12 22:31:40 +02:00
David Arnold
5324431fc0
fix: Testing Module 28000 (#28032)
* fix: logging text

* fix: app handling
2024-10-08 10:14:19 +00:00
David Arnold
7e453ea515
Testing Module (#28000)
* refactor: add create_handler alongside create_logger

* fix: bench helper click exceptions for --help (2nd attempt)

* fix: increase logging level missing test records

* fix: reorganize test runner into testing module and refine logging

* fix: semgrep complaint

* chore: remove unused code; only keep deprecation proxies

* fix: import statements

* fix: output & string processing
2024-10-07 09:46:49 +02:00