Skip to content

Conversation

@antonis
Copy link
Contributor

@antonis antonis commented Dec 18, 2025

📢 Type of change

  • Bugfix
  • New feature
  • Enhancement
  • Refactoring

📜 Description

Increase Maestro driver startup timeout

💡 Motivation and Context

Flaky test on main. At this point the Test ios production REV2 seems to be failing consistently after 6+ retries (passed on the 7th retry)

💚 How did you test it?

CI

📝 Checklist

  • I added tests to verify changes
  • No new PII added or SDK only sends newly added PII if sendDefaultPII is enabled
  • I updated the docs if needed.
  • I updated the wizard if needed.
  • All tests passing
  • No breaking changes

🔮 Next steps

#skip-changelog

@antonis antonis added the ready-to-merge Triggers the full CI test suite label Dec 18, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Dec 18, 2025

Android (legacy) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 412.55 ms 438.36 ms 25.81 ms
Size 43.75 MiB 48.08 MiB 4.33 MiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
eb07ba3 470.04 ms 473.35 ms 3.31 ms
0b64753+dirty 448.67 ms 474.61 ms 25.94 ms
1c38acd+dirty 398.09 ms 409.18 ms 11.09 ms
294387d+dirty 424.30 ms 465.40 ms 41.10 ms
8d0a325+dirty 406.48 ms 415.02 ms 8.54 ms
5ee3314+dirty 415.80 ms 426.14 ms 10.34 ms
5602cc4+dirty 419.91 ms 439.52 ms 19.61 ms
59f3a84+dirty 382.16 ms 376.45 ms -5.71 ms
46e3d54+dirty 467.76 ms 487.53 ms 19.78 ms
ebf60f9+dirty 378.38 ms 405.48 ms 27.10 ms

App size

Revision Plain With Sentry Diff
eb07ba3 17.75 MiB 20.15 MiB 2.41 MiB
0b64753+dirty 17.75 MiB 19.70 MiB 1.95 MiB
1c38acd+dirty 43.75 MiB 48.08 MiB 4.33 MiB
294387d+dirty 43.75 MiB 48.04 MiB 4.29 MiB
8d0a325+dirty 43.75 MiB 48.08 MiB 4.33 MiB
5ee3314+dirty 17.75 MiB 19.70 MiB 1.95 MiB
5602cc4+dirty 43.75 MiB 48.07 MiB 4.32 MiB
59f3a84+dirty 17.75 MiB 19.70 MiB 1.95 MiB
46e3d54+dirty 43.75 MiB 47.99 MiB 4.24 MiB
ebf60f9+dirty 43.75 MiB 48.07 MiB 4.32 MiB

Previous results on branch: antonis/ci-sample-maestro-timeout

Startup times

Revision Plain With Sentry Diff
2ce431b+dirty 508.20 ms 547.84 ms 39.64 ms

App size

Revision Plain With Sentry Diff
2ce431b+dirty 43.75 MiB 48.08 MiB 4.33 MiB

@github-actions
Copy link
Contributor

github-actions bot commented Dec 18, 2025

Android (new) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 426.51 ms 447.65 ms 21.14 ms
Size 43.94 MiB 48.91 MiB 4.97 MiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
c7f264b+dirty 356.98 ms 407.46 ms 50.48 ms
c94a927+dirty 411.32 ms 443.18 ms 31.86 ms
1c38acd+dirty 411.84 ms 470.18 ms 58.34 ms
294387d+dirty 359.44 ms 393.40 ms 33.97 ms
083f560+dirty 383.96 ms 417.76 ms 33.80 ms
8d0a325+dirty 430.13 ms 476.52 ms 46.39 ms
a02e30b+dirty 346.13 ms 381.76 ms 35.62 ms
05bef0e+dirty 451.63 ms 533.90 ms 82.27 ms
e2fa43d+dirty 326.56 ms 372.88 ms 46.32 ms
5602cc4+dirty 374.87 ms 396.74 ms 21.87 ms

App size

Revision Plain With Sentry Diff
c7f264b+dirty 7.15 MiB 8.41 MiB 1.26 MiB
c94a927+dirty 7.15 MiB 8.43 MiB 1.28 MiB
1c38acd+dirty 43.94 MiB 48.91 MiB 4.97 MiB
294387d+dirty 43.94 MiB 48.87 MiB 4.93 MiB
083f560+dirty 7.15 MiB 8.43 MiB 1.28 MiB
8d0a325+dirty 43.94 MiB 48.91 MiB 4.97 MiB
a02e30b+dirty 7.15 MiB 8.42 MiB 1.27 MiB
05bef0e+dirty 7.15 MiB 8.43 MiB 1.28 MiB
e2fa43d+dirty 7.15 MiB 8.42 MiB 1.27 MiB
5602cc4+dirty 43.94 MiB 48.90 MiB 4.96 MiB

Previous results on branch: antonis/ci-sample-maestro-timeout

Startup times

Revision Plain With Sentry Diff
2ce431b+dirty 323.09 ms 372.55 ms 49.47 ms

App size

Revision Plain With Sentry Diff
2ce431b+dirty 43.94 MiB 48.91 MiB 4.97 MiB

@github-actions
Copy link
Contributor

github-actions bot commented Dec 18, 2025

iOS (legacy) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 1210.20 ms 1209.28 ms -0.92 ms
Size 3.44 MiB 4.59 MiB 1.15 MiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
170d5ea+dirty 1219.27 ms 1231.90 ms 12.63 ms
9f211e3+dirty 1218.80 ms 1233.88 ms 15.08 ms
8e653ac+dirty 1218.63 ms 1223.88 ms 5.24 ms
c94a927+dirty 1227.14 ms 1239.64 ms 12.50 ms
d081295+dirty 1214.40 ms 1211.27 ms -3.13 ms
69602ce+dirty 1235.65 ms 1230.82 ms -4.83 ms
0b64753+dirty 1232.49 ms 1226.96 ms -5.53 ms
f234eb4+dirty 1227.22 ms 1228.45 ms 1.22 ms
20d5eaa+dirty 1231.12 ms 1226.00 ms -5.12 ms
d1bfbde+dirty 1216.83 ms 1212.83 ms -3.99 ms

App size

Revision Plain With Sentry Diff
170d5ea+dirty 2.63 MiB 3.98 MiB 1.35 MiB
9f211e3+dirty 2.63 MiB 3.91 MiB 1.28 MiB
8e653ac+dirty 2.63 MiB 4.01 MiB 1.38 MiB
c94a927+dirty 2.63 MiB 3.99 MiB 1.36 MiB
d081295+dirty 3.41 MiB 4.59 MiB 1.18 MiB
69602ce+dirty 2.63 MiB 3.91 MiB 1.28 MiB
0b64753+dirty 2.63 MiB 3.98 MiB 1.35 MiB
f234eb4+dirty 2.63 MiB 4.00 MiB 1.37 MiB
20d5eaa+dirty 2.63 MiB 3.81 MiB 1.18 MiB
d1bfbde+dirty 3.41 MiB 4.58 MiB 1.17 MiB

Previous results on branch: antonis/ci-sample-maestro-timeout

Startup times

Revision Plain With Sentry Diff
2ce431b+dirty 1212.14 ms 1212.66 ms 0.52 ms

App size

Revision Plain With Sentry Diff
2ce431b+dirty 3.44 MiB 4.59 MiB 1.15 MiB

@github-actions
Copy link
Contributor

github-actions bot commented Dec 18, 2025

iOS (new) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 1213.53 ms 1215.18 ms 1.65 ms
Size 3.44 MiB 4.59 MiB 1.15 MiB

Baseline results on branch: main

Startup times

Revision Plain With Sentry Diff
170d5ea+dirty 1233.96 ms 1242.54 ms 8.58 ms
9f211e3+dirty 1215.38 ms 1218.15 ms 2.77 ms
8e653ac+dirty 1215.46 ms 1220.20 ms 4.75 ms
c94a927+dirty 1211.33 ms 1223.31 ms 11.97 ms
d081295+dirty 1205.24 ms 1207.52 ms 2.28 ms
69602ce+dirty 1230.59 ms 1230.84 ms 0.24 ms
0b64753+dirty 1225.77 ms 1232.98 ms 7.21 ms
f234eb4+dirty 1233.52 ms 1235.78 ms 2.26 ms
20d5eaa+dirty 1224.67 ms 1223.16 ms -1.51 ms
d1bfbde+dirty 1221.30 ms 1218.70 ms -2.60 ms

App size

Revision Plain With Sentry Diff
170d5ea+dirty 3.19 MiB 4.55 MiB 1.36 MiB
9f211e3+dirty 3.19 MiB 4.48 MiB 1.29 MiB
8e653ac+dirty 3.19 MiB 4.58 MiB 1.39 MiB
c94a927+dirty 3.19 MiB 4.56 MiB 1.37 MiB
d081295+dirty 3.41 MiB 4.59 MiB 1.18 MiB
69602ce+dirty 3.19 MiB 4.48 MiB 1.29 MiB
0b64753+dirty 3.19 MiB 4.55 MiB 1.36 MiB
f234eb4+dirty 3.19 MiB 4.57 MiB 1.38 MiB
20d5eaa+dirty 3.19 MiB 4.38 MiB 1.19 MiB
d1bfbde+dirty 3.41 MiB 4.58 MiB 1.17 MiB

Previous results on branch: antonis/ci-sample-maestro-timeout

Startup times

Revision Plain With Sentry Diff
2ce431b+dirty 1226.09 ms 1220.19 ms -5.90 ms

App size

Revision Plain With Sentry Diff
2ce431b+dirty 3.44 MiB 4.59 MiB 1.15 MiB

@antonis antonis marked this pull request as ready for review December 18, 2025 13:00
@antonis antonis enabled auto-merge (squash) December 23, 2025 12:09
@antonis antonis merged commit 780b283 into main Dec 23, 2025
70 checks passed
@antonis antonis deleted the antonis/ci-sample-maestro-timeout branch December 23, 2025 12:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready-to-merge Triggers the full CI test suite

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants