Commit Graph

54 Commits

Author SHA1 Message Date
Stefan Ceriu 1e63aea550 Bump the codecov action from 3.1.6 to 5.5.2 2025-12-16 17:57:30 +02:00
Stefan Ceriu 45aec9d006 Converge on same comments and behaviours for forks and cancelled runs. 2025-12-16 17:57:30 +02:00
Stefan Ceriu 5224fd0818 Remove unnecessary Codecov CLI version argument 2025-12-16 17:57:30 +02:00
Stefan Ceriu 3e9a231443 Replace the now deprecated codecov/test-results-action
As per https://github.com/codecov/test-results-action/pull/129
2025-12-16 17:57:30 +02:00
renovate[bot] 678649a09a Update codecov/test-results-action action to v1.2.1 2025-12-16 08:53:19 +02:00
renovate[bot] e81e6b8309 Update actions/upload-artifact action to v6 2025-12-13 09:41:59 +02:00
renovate[bot] 00b2895e25 Update actions/cache action to v5 2025-12-12 09:30:05 +02:00
renovate[bot] bfa287b3f8 Update actions/checkout action to v6 2025-11-21 14:56:18 +02:00
Stefan Ceriu 99bc0b483c Switch the integration tests to the macos-26 runner
Fixes `No simulators found that are equal to the version of specifier (26.1) and greater than or equal to the version of deployment target (0)` errors
2025-11-21 11:14:06 +02:00
Doug 9cd181ef74 Add timeouts to our GitHub actions. (#4669)
6 hours is way too long and eats up the runners.
2025-10-28 18:37:15 +00:00
renovate[bot] f3415e4ef1 Update actions/upload-artifact action to v5 2025-10-27 10:10:37 +01:00
Stefan Ceriu 9874d6fd84 Switch all workflow runners back to macos-15 in hope that it will require less ram and won't time out. 2025-09-29 12:37:28 +03:00
Stefan Ceriu 43b8cfd39b Fix integration tests for Xcode 26 2025-09-26 17:20:41 +03:00
Stefan Ceriu b705eacf48 Switch workflows to the macos-26 runner 2025-09-26 17:20:41 +03:00
renovate[bot] 57686d5f9b Update actions/checkout action to v5 (#4401)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-08-11 18:00:27 +01:00
Doug 5f621411b2 Run Xcode select on the Translations and CalVer workflows. (#4224)
* Run Xcode select on the Translations and CalVer workflows.

* Use ci_common.sh for xcode-select instead.
2025-06-18 16:53:32 +01:00
renovate[bot] 4bcdf58e3b Update codecov/test-results-action action to v1.1.1 2025-05-23 09:35:44 +03:00
Doug eaa6dd9240 Run the UI & Integration tests once a day instead of twice with a 6 hour offset. (#4086) 2025-05-02 13:12:49 +01:00
Mauro Romito e54a588f49 run integration tests on gh ci
possible fix

possible fix

Revert "possible fix"

This reverts commit 6484648153bf8f05485050f544b136e6ca9f0be9.

Revert "possible fix"

This reverts commit abb3a58c630bb0abab7c86a31be022496d4f3b4c.

possible fix

possible solution using ui interrupt monitor

Revert "possible solution using ui interrupt monitor"

This reverts commit ed28c85a37744e615c4bc464b3e8962d8c953be9.

possible fix

Revert "possible fix"

This reverts commit 43039e73c1e1b70493f2e22aa20f925257d2e6de.

fix
2025-04-29 13:42:09 +02:00
Stefan Ceriu 8b070d9a64 Revert codecov/codecov-action changes and add allowedVersions renovate rule. 2025-03-24 13:37:17 +02:00
renovate[bot] 767eb5da30 Update GitHub Actions to v5 2025-03-24 13:37:17 +02:00
renovate[bot] 42aa2bcabc Update codecov/codecov-action action to v3.1.6 2025-03-19 08:39:11 +02:00
Stefan Ceriu ef73677518 Pin all 3rd party github actions to their full length commit SHA
- this is the recommended security practice as per https://docs.github.com/en/actions/security-for-github-actions/security-guides/security-hardening-for-github-actions#using-third-party-actions
2025-03-19 08:22:09 +02:00
Stefan Ceriu bd3f80143b Switch codecov-Action@v3 to v0.7.3 so it runs on Intel macs 2024-09-30 11:59:08 +03:00
Stefan Ceriu be09f77ae2 Switch the integration tests to the perf-only runner 2024-09-30 11:59:08 +03:00
Stefan Ceriu 9d23dec2e9 Tracing and integration test tweaks (#3336)
* Disable image and document picker integration tests as they randomly fail to load and are flakey.

* Delete any pre-existing log files

* Various tracing tweaks and fixes:
- delete the custom tracing log levels as we can't control their ouput
- implement comparable on them
- change default levels only if the new chosen level increases their verbosity

* Make logging targets mandatory and fix their logging levels

* Switch back to using the `run_tests` reset simulator flag as `fastlane snapshot reset_simulators` was too generic and slow

* Switch all integration test taps to `tapCenter` (nee forceTap) after noticing missed taps on CI.

* Make the logging file prefix explicit, let the main app not use one.

* Rename tracing configuration `target` to `currentTarget`
2024-09-27 15:08:47 +03:00
Doug 4d7d687954 Start fixing flakey tests ❄️ (#3329)
* Wait longer on authentication flow tests.

* Move default perceptualPrecision value into the snapshot preferences.

* Delay snapshots *before* setting up the test.

* Reset the simulators on GitHub before running?

* Remove a test that is now handled by Rust.

* Fix a test that was yielding.
2024-09-26 16:09:01 +01:00
Stefan Ceriu dc6d7f2985 Integration test improvements (#3330)
* Send a message from integration tests and check that it doesn't show up in the app logs
* Increase photo library timeout

* Wait for image tapping to process

* Send a message using the rich text editor too

* Wait for the various pickers to finish loading

* Set all logs to `trace` in integration tests

* Close formatting options after sending the second message

* Make sure logs are actually sent to tracing and get redirected to the right file

* Switch from using a custom `trace` log configuration to the lowest level `TracingConfiguration` we support
2024-09-26 10:15:09 +03:00
Stefan Ceriu 5acfb5dd87 Try to stop random codecov test result action failures from failing the whole test run. 2024-09-18 15:22:34 +03:00
Doug 022cc59d56 Try uploading test results to Codecov. (#3266) 2024-09-12 07:09:15 +01:00
Stefan Ceriu f6c8aae09e Switch codecov-action back to v3 as 4 significantly decreases coverage
- previously seen in https://github.com/element-hq/element-x-ios/pull/2727
2024-09-10 11:55:18 +03:00
Stefan Ceriu dc85cb10ed Stop running and publishing performance metrics to gh-pages 2024-09-05 13:49:56 +03:00
renovate[bot] c132f67913 Update GitHub Actions 2024-09-03 18:21:22 +03:00
Stefan Ceriu c73a60dca7 Revert "Update GitHub Actions"
This reverts commit a6cdbc3329.
2024-09-03 18:14:28 +03:00
renovate[bot] a6cdbc3329 Update GitHub Actions 2024-09-03 15:50:57 +03:00
Doug aa71f10b40 Run the integration tests on GitHub again. (#3052) 2024-07-17 10:16:43 +01:00
renovate[bot] 19a8f60976 Update actions/upload-artifact action to v4 2024-05-20 11:19:12 +01:00
renovate[bot] f197368dba Update actions/checkout action to v4 2024-05-20 11:14:18 +01:00
renovate[bot] 7d5d150d26 Update actions/cache action to v4 2024-05-20 11:11:46 +01:00
manuroe a3ec0b8505 Codecov: Add token for codecov-action@v3 to fix coverage report (#2727)
Moving to v4 is blocked because of a fundamental issue with https://github.com/codecov/codecov-action/issues/1279 on our mac runners and because the reported coverage is [decreasing with v4](https://app.codecov.io/gh/element-hq/element-x-ios/pull/2719/flags)
2024-04-22 14:59:51 +02:00
Doug 5f0c782ce2 Use xcresultparser in all workflows. (#2510)
* Fix integration tests.
2024-02-28 18:01:20 +00:00
Doug dff18d7851 UI Tests fixes. (#1322)
* Fix broken UI tests and update snapshots.

* Tweak workflow.

* Update schedule and zip the result bundle.
2023-07-13 16:10:41 +01:00
Michael Kaye 448db8a8e9 Disabling automatic cancellation as it is affecting testing. (#1271) 2023-07-07 09:56:29 +01:00
Michael Kaye 28d241d39b Stop asserting integration test run time & move to performance testing runner. (#1132)
* Stop asserting integration test run time.
* Move integration testing to the perf runner.
2023-06-23 13:44:33 +01:00
Michael Kaye e8caacc85c Parse output from IntegrationTests performance metrics (#1054)
* Parse output and leave as CSV on disk for later usage.
* Minor tweaks to step & file names

Co-authored-by: Stefan Ceriu <stefanc@matrix.org>
2023-06-09 08:44:50 +00:00
Mauro a5d555a33d Fixing Tests for Xcode 14.3 (#888)
* settting macOS to 13, and let's runa test of... the tests

* I want the artifacts of the test, might give me some more insight in Xcode

* archive artifact

* trying a thing with the xcode version

* push notifications alert makes this test fail

* test improvement

* let's try with a very long time

* let's disable autocorrection

* sleep

* 1 seconds fixed 90% of the issue, 2 should fix 100%

* waiting some more time in flaky tests and updated the content of a test that was failing

* updated a screenshot test that had a notification

* this integration test is a bit so flaky increased the timing

* controlled delay waited a bit moe for the timeline to settle

* try await

* MainActor everywhere

* milliseconds fix

* trying with a bit more waiting time after the tap and a slow velocity for the swipe

* let's try waiting more time
2023-05-15 13:42:40 +00:00
Stefan Ceriu 3468ed2a02 Various test fixes (#873)
* Switch back to macos-12 and see if the tests work

* Fix unit tests, add default invited, joined and active member counts to the mock room proxy

* Try running UI tests on 14.3 but on an existing iPad simulator

* Revert "Try running UI tests on 14.3 but on an existing iPad simulator"

This reverts commit b075e7fa384330a9070dc35ed4dded57e0af26e1.
2023-05-11 16:28:35 +03:00
Stefan Ceriu 93e3a1a80b Media uploading (#851)
* MediaUploadingPreprocessor - Prevent images without any GPS metadata from being changed

* Add support for sending images

* Add support for sending video, audio and file attachments

* Rename MediaPickerPreview to MediaUploadPreview

* Move media uploading to the MediaUploadPreviewScreen, add waiting indicators and error handling

* Add support for pasting and drag&dropping in media for upload

* Adopt new media picker source UI, remove developer flag

* Set minimum heights for timeline loadable images

* Fix invalid camera picker file names

* Fix flakey MediaUploadingPreprocessor image tests, improve gps metadata stripping

* UITests: Update existing screenshots and add new step for the room attachment picker

* Switch all github action runners to macos-13

* Cleanup enter key and paste message composer handlers
2023-05-04 16:09:29 +03:00
Stefan Ceriu 7ab64d4cb4 Project file removal (#569)
* Deleted project file

* Add back SPM Package.resolved + .gitignore

* Generate project file on release builds

* Converge on single CI setup scripts within `ci_scripts/ci_common.sh`

* Fix unit tests

* Use new `ci_common/setup_github_actions_environment` setup script on all workflows

* Move lfs validation check to the pre-commit hooks. Remove validate-lfs github actions workflow

* Fix integration tests workflow

* Tweaks following code review
2023-02-13 12:53:01 +00:00
Aleksandrs Proskurins 114328ea65 Update codecov (#356)
* Exclude files that don't belong codecov

* Start tracking coverage from integration tests

* Added IntegrationTests to targets

* Pbxpoj file
2022-12-08 08:09:18 +00:00