How-to: Template Matching
In this exercise, you will get to try out template matching.
Last updated
Was this helpful?
In this exercise, you will get to try out template matching.
Last updated
Was this helpful?
Navigate to and click on "Open in Colab" at the top.
Follow the steps on the notebook, executing each of the Python code blocks in the order in which they appear. To execute a code block, click the Play icon to the left of the block.
Note: After executing the first code block, an upload file widget will appear. This widget allows you to upload an image file from your computer. This, in turn, is the image that will be queried.
Note: After executing the second code block, an upload file widget will appear. This widget allows you to upload an image file from your computer. This, in turn, is the image that will be used as a template.
When viewing the results, you will be able to see a Screenshot Image with the matching bounding box along with a Confidence Score for the match.
Discussion Topic: How useful do you think this would be for testing purposes? Note that this approach allows us to locate elements on an application screen without using a Document Object Model (DOM) or similar page source for mobile applications.
What are some drawbacks of relying on the DOM or on page source?
Discussion Topic: How reliable was the template matching algorithm? How about when changing the various different switches?
For making it even further. Not only have you used deep learning models, but you've also got a simpler, less computationally-intensive technique in your toolbox.
In this exercise, you will:
Enter the following credentials:
Username should be your e-mail address or first + last name.
Password should be admin.
Click on Sign In.
After a few short moments, your unique Jupyter notebook server will be created for you.
Double click the template_matching.ipynb notebook.
Follow the steps on the notebook, executing each of the Python code blocks in the order of which they appear. To execute a code block, first click the block, then click the Play icon.
Note: After executing the first code block, an upload file widget will appear. This widget allows you to upload an image file from your computer. This, in turn, is the image that will be queried.
Note: After executing the second code block, an upload file widget will appear. This widget allows you to upload an image file from your computer. This, in turn, is the image that will be used as a template.
When viewing the results, you will be able to see a Screenshot Image with the matching bounding box along with a Confidence Score for the match.
Discussion Topic: How useful do you think this would be for testing purposes? Note that this approach allows us to locate elements on an application screen without using a Document Object Model (DOM) or similar page source for mobile applications.
What are some drawbacks of relying on the DOM or on page source?
Discussion Topic: How reliable was the template matching algorithm? How about when changing the various different switches?
For making it even further. Not only have you used deep learning models, but you've also got a simpler, less computationally-intensive technique in your toolbox.
, powered by JupyterHub
the template_matching.ipynb Python notebook
the template matching algorithm
produced by template matching
Navigate to and make sure you arrive at the following login screen:
