Isabel Rios[:isabel_rios] Reporter
	Description • 7 years ago

There are a few tests that seems to fail when running on that sim. Some examples seen:
-ReaderView Test 
-TopTab Test

Will add more details of the failures, the logs were lost on BB when branches merged into master. 

It will be good to have all the tests running ok in this sim and maybe changing to this one the BB scheduled builds.

	Isabel Rios[:isabel_rios] Reporter
	Comment 1 • 7 years ago

The problem is with the iOS version, not the device itself.

These are the logs with tests failing:
https://dashboard.buddybuild.com/apps/57bf25c0f096bc01001e21e0/build/5a7dc98fab69dd0001678fb5#tests

The issues are not reproducible manually both on sims or on real devices.

	Isabel Rios[:isabel_rios] Reporter
	Comment 3 • 7 years ago

So far we have seen this issue with iOS 11.2 under two scenarios. 
First one is when running Reader view tests.

Steps
1-Go to www.mozilla.org/en-US/book
2-Tap on Reader view button
3-Check how the content is shown

Actual
Please see screenshot attached Reader View issue. On iOS 11.2 when running the tests instead of the content shown it is shown a white screen. It is like the content is not loaded, it is not a timing issue because it is not shown no matter how long you wait for it, it never appears. 
If you follow the same steps to run the test manually, then it is not reproducible and everything works as expected.

	Isabel Rios[:isabel_rios] Reporter
	Comment 4 • 7 years ago

So, since the content in reader view is not shown fine, when adding it to the reader list, it is not shown fine either. Please see screenshot attached

	Isabel Rios[:isabel_rios] Reporter
	Comment 5 • 7 years ago

Second scenario is when checking the url bar buttons. 
https://github.com/mozilla-mobile/firefox-ios/blob/master/XCUITests/ToolbarTest.swift#L26

Steps
1-From HomePanel screen type an url in the url bar
2-Once the webpage is loaded check the back/forward/reload buttons

Actual
The back button should be enabled but it is not. This happens on iPad sim only and it can be reproduced both when running the tests automatically and manually.

This is working fine on iOS 11.0 and on real devices with iOS 11.2.5

	Isabel Rios[:isabel_rios] Reporter
	Comment 7 • 7 years ago

We are wondering whether the Webkit issue is the root cause of this problem (bug: https://bugs.webkit.org/show_bug.cgi?id=179885)

In theory there will be a fix on iOS 11.3b2. 

So in order to enable the test to run on latest sim, we should disable the failing tests or wait till the fix is available in latest sim version.

	Isabel Rios[:isabel_rios] Reporter
	Comment 8 • 6 years ago

This issue is still happening on iOS 11.3