Exercise: Object Detection

In this exercise, we will try out Google's Cloud Vision API to get a feel for how AI can be used for object detection.

Google Cloud Vision API

1. Navigate to https://cloud.google.com/vision.

2. Scroll down to the Try the API section.

Try Cloud Vision API

1. Drag in an image. Here's one you can use:

Sample Application Screen

You'll need to solve a Captcha Challenge that is easy to miss (you may need to scroll down).

Viewing the Results

When viewing the results, you will be able to see Objects, Labels, Text, and Properties. Click on the tabs below to learn more about each of the result types.

You can also see the raw JSON request and response payloads, which are useful when integrating with Google Cloud Vision API.

Objects

The below results show us that Google Cloud Vision API was able to find two objects:

• lighting with 82% confidence

• couch with 54% confidence

Discussion Topic: How useful do you think this would be for testing purposes?

Labels

According to Google Cloud Vision API, the following labels may be applied

Suggested Labels Sorted by Confidence

Discussion Topic: How useful do you think this would be for testing purposes?

Text

According to Google Cloud Vision API, the following text blocks were detected:

Discussion Topic: How useful do you think this would be for testing purposes?

Properties

Google Cloud Vision API also provides a few additional details about the image, such as the dominant colors:

Dominant Colors and Crop Hints

Request/Response Payloads

Request/Response Payloads

Meta: Segment Anything

Try out Meta's SAM too!

https://segment-anything.com/demo