1

我正在尝试调试大约 3% 的时间失败的 Android UI 测试。

我们的测试类开始是这样的：

@RunWith(AndroidJUnit4.class)
public class ActionWidgetAdapterTest {

    private Solo solo;

    @Rule
    public ActivityTestRule<SampleContainer> mActivityRule = new ActivityTestRule<>(SampleContainer.class);

    // SampleContainer is used exclusively for the test case and extends AppCompatActivity

    @Before
    public void setUp() throws Exception {
        solo = new Solo(InstrumentationRegistry.getInstrumentation(), mActivityRule.getActivity());
    }

    @After
    public void tearDown() throws Exception {
        solo.finishOpenedActivities();
    }
    // rest of class
    // [...]
}

有问题的测试用例如下：

@Test
@LargeTest
@FlakyTest
public void testAddActions() throws Exception {

    final ArrayList<Action> actions = new ArrayList<>();

    // Action is our in-house version of the Action class from the Leanback library
    final Action a1 = new Action(0, "text1", R.drawable.action_button_focused);
    final Action a2 = new Action(1, "text2", R.drawable.action_button_focused);
    final Action a3 = new Action(0, "text3", R.drawable.action_button_focused);
    final Action a4 = new Action(1, "text4", R.drawable.action_button_focused);

    actions.add(a1);
    actions.add(a2);
    actions.add(a3);
    actions.add(a4);

    // handler for posting to the main thread
    Handler mainHandler = new Handler(mActivityRule.getActivity().getBaseContext()
                                                                 .getMainLooper());

    Runnable myRunnable = () -> {

        // add actions to adapter
        mActivityRule.getActivity().mActionWidgetAdapter.addActions(actions);
    };
    mainHandler.post(myRunnable);

    solo.sleep(1000); // pause to resolve any timing issues
    assertTrue(mActivityRule.getActivity().mActionWidgetAdapter.getItemCount() == 4);

    // test edge case - navigate all the way to the left
    solo.sendKey(Solo.LEFT);
    pressUpDownEnter();
    solo.sendKey(Solo.LEFT);
    pressUpDownEnter();
    solo.sendKey(Solo.LEFT);
    pressUpDownEnter();
    solo.sendKey(Solo.LEFT);
    pressUpDownEnter();
    solo.sendKey(Solo.LEFT);

    assertTrue(solo.getImageButton(0).isFocused());
    assertFalse(solo.getImageButton(2).isFocused());
}

测试用例大部分时间都通过了。但是，执行时失败的可能性很小assertTrue(solo.getImageButton(0).isFocused());；发生这种情况时，Robotium 会抱怨“找不到 3 个 ImageButtons”。这似乎没有任何模式。我将 Robotium 框架升级到了最新版本，但这并不能解决问题。

有人知道我们做错了什么吗？

4

1 回答 1

1

我相信我已经找到了原因。据我所知，问题是由于tearDown(). 根据 Robotium 源代码，finishOpenedActivities()通过三次发送后退按钮来工作。但是，这似乎是在单独的线程上完成的。结果，即使新的测试用例开始，命令也可能继续发送，导致被测试的应用程序从视图中消失，并导致 Robotium 无法读取 UI。

考虑到应用程序已经在每次测试结束时被杀死，finishOpenedActivities()这似乎有点多余。在我注释掉那行之后，这个问题就没有再出现了。

于 2016-09-17T05:44:39.807 回答