Overview

You can read and import target images as texts or tables using the OCR server (Orchestrator) which has the built-in commercial Abbyy engine provided by the Abbyy library.
Also, using the Optical Character Recognition (OCR) server, you can convert the text and tables on images into text strings and array data.
The Abbyy library features require the OCR server for operation. Therefore, they can be operated only when you are logged in to the Designer account.

The features provided by the Abbyy library are as follows:

OCR features for extracting information from images: GetImageText, GetImageTextInfo, GetImageTable, GetImageFieldData, GetPDFFieldData, GetTextOnFile, GetTextInfoOnFile, GetTableOnFile
Mouse actions based on the information extracted from images using OCR: TextClick, TextDoubleClick, TextRightClick, TextHover

Use Designer or File Explorer to refer to the samples of the Abbyy library.

• On Designer: Menu > Help > Sample > Sample > Abbyy

• On File Explorer: C:\Users\user\AppData\Roaming\Brity RPA Designer\samples\Abbyy

[Abbyy sample project names and related activity cards]

• Abbyy_Mouse: TextClick, TextDoubleClick, TextHover, TextRightClick

• Get Text: GetImageTable, GetImageTextInfo, GetImageText, GetImageFieldData, GetTableOnfile, GetTextInfoOnFile, GetTextOnFile

Installing the Abbyy library

For Abbyy library installation , please refer to Installing Add-In Library

Close both Brity RPA Designer and Bot before installation.

Common Properties

IMAGE

Display the information about the captured image (size and position).

Card properties
Properties	Type	Required	Unit	Auto-setting	Description
Image	Image	Y	-	Y	View captured images.
Bounds	String	N	-	Y	Shows the position and size of the target UI object specified by the user as relative coordinates based on the screen. (Unit: Pixel) X: Horizontal Y: Vertical W: Width H: Height Ex.) '0,0,,100,100' You can also specify the coordinates with a variable.

OCR

Specify settings related to OCR.

Card properties
Properties	Type	Required	Unit	Auto-setting	Description
PDFPage	Number	Y	-	Y	Specify the image number to read on a PDF file.
FilePath	Text	Y	-	N	Enter the path for the PDF file to perform the OCR.
Template	Combination box	N	-	Y	Select the type of the template created on the OCR portal. You can select “Auto” in the combination box to select a template registered on the OCR portal.
Language	Combination box	N	-	Y	Specify the language of the document to read. - ALL: Automatically identifies the language. (However, the performance will be enhanced when you specify the language.) - Korean(Hangul) - English
Scale(%)	Number	Y	-	Y	Enter the resize scale (%) of the source image for the OCR.
Target Text	Text	Y		N	Enter the text to search and click.
GrayFilter	Toggle button	N	-	Y	When set to "True," this option converts the image to black and white. When set to "False," this option is not used (colors other than black and white).
ThresholdFilter	Toggle button	N	-	Y	When set to "True," this option converts the image to black and white. When set to "False," this option is not used. It must be used with the GrayFilter.

MORE OPTIONS

Card properties
Properties	Type	Required	Unit	Auto-setting	Description
Timeout(Sec)	Number	Y	sec	Y	Enter the delay time until the event ends. (Seconds)
Draw Bounds	Toggle Button	N	-	Y	Select whether to draw a border on target image when executing.
On Error	Combination box	N	-	N	Select the processing method for occurred errors. - --Ignore--: Ignore the error and proceed. - --Retry--: Try the task one more time. -- Goto--: Try the scenario for the specified time if the activity fails. - _Event: Select an event created within the project.

DESCRIPTION

Card properties
Properties	Type	Required	Unit	Auto-setting	Description
Description	Text	N	-	N	Enter the description for the activity card. The description entered in the Description field is used as the description of the activity. A representative value will be displayed in the absence of the Description input.

GetImageText

Overview

This activity card recognizes and extracts the text in an image.

Application procedures

This activity card requires the OCR server for operation. Therefore, it can be operated only when you are logged in to the Designer account.

Double-click No Target on the activity card.
Specify the range of the image to extract the text.
In the [Output] Output field, enter the variable to store the text extracted from the specified boundary of the image.
In the Properties window, specify other required properties.

Card output properties

Property	Type	Additional comments	Description	Example
Output	String	-	Returns the text extracted using OCR.	'I'm Feeling Lucky'

Card input properties

Card properties
Common	Properties	Type	Required	Unit	Auto-setting	Description
N	Search Bounds	Text	Y	-	Y	Enter the boundary data (x, y, width, height) on the screen to search for the image. The boundary data will be automatically filled in when you specify the boundary by clicking No Target.
Y	IMAGE	-	-	-	-	Common property of the Abbyy library.
Y	OCR	-	-	-	-	Common property of the Abbyy library.
Y	MORE OPTIONS	-	-	-	-	Common property of the Abbyy library.
Y	DESCRIPTION	-	-	-	-	Common property of the Abbyy library.

Example of utilization

Open a website and extract the text in the image on the screen. Then, output the text in a message box and close the browser.

Excel_NewExcel_1K

Sample file

Menu > Help > Sample > Sample > Abbyy > Get Text > P_GetImageText_Test

Used variables

openBrowser = Variable to specify the launched browser
waitImage: Variable to store the verification result of whether the target image is displayed
getText: Variable that stores the extracted text string.

Used properties

[Output] Output = RESULT
Search Bounds = '1051,201,299,49'

The text result based on the sample OCR image

INVOICE

Date: 2019.12.03 SAMSUNG SDS CORP.

Request Number: #100000

Related/Similar activities

GetImageTextInfo, GetImageTable

GetImageTextInfo

Overview

This activity card recognizes the text on a specified image and returns it with the image information, such as the width and height.

Application procedures

This activity card requires the OCR server for operation. Therefore, it can be operated only when you are logged in to the Designer account.

Double-click No Target on the activity card.
Specify the range of the image to extract the text.
In the [Output] Output field, enter the variable to store the image information fetched from the specified boundary of the image.
In the Properties window, specify other required properties.

Card output properties

Property	Type	Additional comments	Description	Example
Output	Object	-	Returns image information (text, position, height, width) using OCR.	Bounds(551,119,269,89)-Text(Google) Bounds(571,323,75,15)-Text (Search Google) Result.RectList[0].Text > 'Google' Result.RectList[0].XPos > 551 Result.RectList[0].YPos > 119 Result.RectList[0].Width > 75 Result.RectList[0].Height > 15

Property

Type

Additional comments

Description

Example

Output

Object

Returns image information (text, position, height, width) using OCR.

Bounds(551,119,269,89)-Text(Google)

Bounds(571,323,75,15)-Text (Search Google)

Result.RectList[0].Text > 'Google'

Result.RectList[0].XPos > 551

Result.RectList[0].YPos > 119

Result.RectList[0].Width > 75

Result.RectList[0].Height > 15

Card input properties

Card properties
Common	Properties	Type	Required	Unit	Auto-setting	Description
N	Search Bounds	Text	Y	-	Y	Enter the boundary data (x, y, width, height) on the screen to search for the image. The boundary data will be automatically filled in when you specify the boundary by clicking No Target.
Y	IMAGE	-	-	-	-	Common property of the Abbyy library.
Y	OCR	-	-	-	-	Common property of the Abbyy library.
Y	MORE OPTIONS	-	-	-	-	Common property of the Abbyy library.
Y	DESCRIPTION	-	-	-	-	Common property of the Abbyy library.

Example of utilization

Open the Google website (http://www.google.com) and extract the text in the image. Then, output the text along with the image information and close the browser.

Excel_NewExcel_1K

Sample file

Menu > Help > Sample > Sample > Abbyy > Get Text > P_GetImageTextInfo_Test

Used variables

openBrowser = Variable to specify the launched browser
waitImage = Variable to store the verification result of whether the target image is displayed
getText = Variable that stores the extracted text
getImageTextInfo = Variable that stores the fetched image information after performing the OCR
getPoint = Variable that specifies the image boundary

Used properties

[Output] Output = this.getImageTextInfo
Search Bounds = this.getPoint

Related/Similar activities

GetImageText , GetImageTable

GetImageTable

Overview

This activity card recognizes a table on a specified image and reads the text in the table.

Application procedures

This activity card requires the OCR server for operation. Therefore, it can be operated only when you are logged in to the Designer account.

Double-click No Target on the activity card.
Specify the range of the image to extract the text.
In the [Output] Output field, enter the variable to store the data fetched from the table boundary of the image.
In the Properties window, specify other required properties.

Card output properties

Property	Type	Additional comments	Description	Example
Output	2D Array	String	Returns the text in the table imported using OCR as a two-dimensional array.	0: A \| B \| C 1: 1 \| 2 \| 3 2: 4 \| 5 \| 6

Property

Type

Additional comments

Description

Example

Output

2D Array

String

Returns the text in the table imported using OCR as a two-dimensional array.

0: A | B | C

1: 1 | 2 | 3

2: 4 | 5 | 6

Card input properties

Card properties
Common	Properties	Type	Required	Unit	Auto-setting	Description
N	Search Bounds	Text	Y	-	Y	Enter the boundary data (x, y, width, height) on the screen to search for the image. The boundary data will be automatically filled in when you specify the boundary by clicking No Target.
Y	IMAGE	-	-	-	-	Common property of the Abbyy library.
Y	OCR	-	-	-	-	Common property of the Abbyy library.
Y	MORE OPTIONS	-	-	-	-	Common property of the Abbyy library.
Y	DESCRIPTION	-	-	-	-	Common property of the Abbyy library.

Example of utilization

Open a web page with the OpenBrowser activity card and search for the text included in a table on the web page with the GetImageTable activity card.

Excel_NewExcel_1K

Sample file

Menu > Help > Sample > Sample > Abbyy > Get Text > P_GetImageTable_Test

Used variables

openBrowser = Variable to specify the launched browser
waitImage = Variable to store the verification result of whether the target image is displayed
getTable = Variable that specifies the text extracted from a table
getPoint = Variable that specifies the image boundary

Used properties

[Output] Output = this.getTable
Search Bounds = '5,79,719,90'

Related/Similar activities

GetImageText , GetImageTextInfo

GetTextOnFile

Overview

This activity card recognizes text on a specific image file through OCR and converts the data into text strings.

Application procedures

This activity card requires the OCR server for operation. Therefore, it can be operated only when you are logged in to the Designer account.

In the [Output] Output field, enter the variable to store the text fetched through OCR.
In the FilePath field, enter the path and name of the file to fetch the text from.
In the Properties window, specify other required properties.

Card output properties

Property	Type	Additional comments	Description	Example
Output	String	-	Returns the text extracted using OCR.	'INVOICE'

Card input properties

Card properties
Common	Properties	Type	Required	Unit	Auto-setting	Description
Y	OCR	-	-	-	-	Common property of the Abbyy library.
Y	MORE OPTIONS	-	-	-	-	Common property of the Abbyy library.
Y	DESCRIPTION	-	-	-	-	Common property of the Abbyy library.

Example of utilization

Extract the text in the image file (Invoice.JPG), store the text in the variable (readText), and then output the text in a message box.

Excel_NewExcel_1K

Sample file

Menu > Help > Sample > Sample > Abbyy > Get Text > P_GetTextOnFile_Test

Used variables

resultText = Variable to store the text extracted from the image

Used properties

[Output] Output = this.readText
Scale(%) = 100
FilePath = Global.ResourcesDir + 'Invoice.JPG'
GrayFilter = OFF
ThreadholdFilter = OFF

Related/Similar activities

GetTextInfoOnFile, GetTableOnFile

GetTextInfoOnFile

Overview

This activity card extracts text data and image information, such as the position, width, and height, from a specific image file through OCR.

Application procedures

This activity card requires the OCR server for operation. Therefore, it can be operated only when you are logged in to the Designer account.

In the [Output] Output field, enter the variable to store the text data and image fetched through OCR.
In the FilePath field, enter the path and name of the file to fetch the text and image information from.
In the Properties window, specify other required properties.

Card output properties

Property	Type	Additional comments	Description	Example
Output	Object	-	Returns image information (position, text, height, width) using OCR.	Bounds(409,47,181,29)-Text(INVOICE) Table[0][0] Bounds(132,264,50,15)-Text(DATE) ※ For detailed examples, please refer to the note below.

Property

Type

Additional comments

Description

Example

Output

Object

Returns image information (position, text, height, width) using OCR.

Bounds(409,47,181,29)-Text(INVOICE)

Table[0][0]

Bounds(132,264,50,15)-Text(DATE)

※ For detailed examples, please refer to the note below.

Card input properties

Card properties
Common	Properties	Type	Required	Unit	Auto-setting	Description
Y	OCR	-	-	-	-	Common property of the Abbyy library.
Y	MORE OPTIONS	-	-	-	-	Common property of the Abbyy library.
Y	DESCRIPTION	-	-	-	-	Common property of the Abbyy library.

Example of utilization

Extract the text and boundary data of the image file (Invoice.JPG), store the data in a variable, and then output all of the boundary data and text (including text in tables) in a message box.
- Output the text string in the second row and third column of the table in a message box. (Result: '10')
- Output the first text string outside the table. (Result: 'INVOICE')

Excel_NewExcel_1K

Sample file

Menu > Help > Sample > Sample > Abbyy > Get Text > P_GetTextInfoOnFile_Test

Used variables

openBrowser = Variable to specify the launched browser
waitImage = Variable to store the verification result of whether the target image is displayed
getTable = Variable that specify the text extracted from a table
getImageTextInfo = Variable to store the text and boundary data fetched from the image

Used properties

[Output] Output = this.result
Scale(%) = 100
FilePath = Global.ResourcesDir + 'Invoice.JPG'
GrayFilter = ON
ThreadholdFilter = ON

The text information result based on the sample OCR image

• result Table information

result.TableList[0].RowList[0].ColList[0].RectList[0].Text -> DATE

• result Text information

result.RectList[0].Text -> INVOICE

• result value

Table[0][0]

Bounds(206,459,93,29)-Text(DATE)

Table[0][1]

Bounds(623,460,83,28)-Text(ITEM)

Table[0][2]

Bounds(935,459,159,29)-Text(AMOUNT)

Table[0][3]

Bounds(1303,459,248,29)-Text(DESCRIPTION)

Table[1][0]

Bounds(162,564,179,28)-Text(2019.11.29)

Table[1][1]

Bounds(606,564,119,29)-Text(ITEM A)

Table[1][2]

Bounds(997,564,38,29)-Text(10)

Table[1][3]

Bounds(1362,564,125,29)-Text(DESC1)

Table[2][0]

Bounds(162,669,179,28)-Text(2019.11.30)

Table[2][1]

Bounds(605,669,119,29)-Text(ITEMB)

Table[2][2]

Bounds(995,669,40,29)-Text(20)

Table[2][3]

Bounds(1362,669,130,29)-Text(DESC2)

Table[3][0]

Bounds(161,774,176,27)-Text(2019.12.01)

Table[3][1]

Bounds(604,774,122,29)-Text(ITEMC)

Table[3][2]

Bounds(995,774,40,29)-Text(30)

Table[3][3]

Bounds(1362,774,130,29)-Text(DESC3)

Table[4][0]

Bounds(161,879,181,27)-Text(2019.12.02)

Table[4][1]

Bounds(604,879,121,29)-Text(ITEMD)

Table[4][2]

Bounds(994,879,41,29)-Text(40)

Table[4][3]

Bounds(1362,879,130,29)-Text(DESC4)

Bounds(721,56,336,56)-Text(INVOICE)

Bounds(83,242,1609,27)-Text(Date: 2019.12.03 SAMSUNG SDS CORP.)

Bounds(83,285,447,35)-Text(Request Number: #100000)

Related/Similar activities

GetTextOnFile, GetTableOnFile

GetTableOnFile

Overview

This activity card recognizes tables on a specific image file through OCR and returns the data to a two-dimensional array variable.

Application procedures

This activity card requires the OCR server for operation. Therefore, it can be operated only when you are logged in to the Designer account.

In the [Output] Output field, enter the variable to store the text extracted from the table in the file.
In the FilePath field, enter the path and name of the file to fetch the table text from.
In the Properties window, specify other required properties.

Card output properties

Property	Type	Additional comments	Description	Example
Output	2D Array	String	Use OCR to return the text in a table of a specific image file as a two-dimensional array.	0: A \| B \| C 1: 1 \| 2 \| 3 2: 4 \| 5 \| 6

Property

Type

Additional comments

Description

Example

Output

2D Array

String

Use OCR to return the text in a table of a specific image file as a two-dimensional array.

0: A | B | C

1: 1 | 2 | 3

2: 4 | 5 | 6

Card input properties

Card properties
Common	Properties	Type	Required	Unit	Auto-setting	Description
Y	OCR	-	-	-	-	Common property of the Abbyy library.
Y	MORE OPTIONS	-	-	-	-	Common property of the Abbyy library.
Y	DESCRIPTION	-	-	-	-	Common property of the Abbyy library.

Example of utilization

Extract the table text in the image file (Invoice.JPG), store the text in the two-dimensional array variable (resultObj), and then output the text in a message box.

Excel_NewExcel_1K

Sample file

Menu > Help > Sample > Sample > Abbyy > Get Text > P_GetTableOnFile_Test

Used variables

resultObj = The two-dimensional array variable to store the text read from the table on the image

Used properties

[Output] Output = this.resultObj
Scale(%) = 100
FilePath = Global.ResourcesDir + 'Invoice.JPG'
GrayFilter = ON
ThreadholdFilter = ON

Related/Similar activities

GetTextOnFile, GetTextInfoOnFile

GetImageFieldData

Overview

This activity card compares a specific image file with the template registered on the OCR portal and reads the labels and values of the predefined fields.

Application procedures

This activity card requires the OCR server for operation. Therefore, it can be operated only when you are logged in to the Designer account.

In the FilePath field, enter the complete path of the file and the file name.
In the Properties window, specify other required properties.

Card output properties

Property	Type	Additional comments	Description	Example
Output	Object	-	Returns the label and value of a field fetched using OCR.	"Field1": "Date:2019.12.03 SAMSUNG SDS CORP.", "Field2": "Request Number:#100000" "Table": [{ "Field1": "DATE", "Field2": "ITEM" }] ※ For detailed examples, please refer to the note below.

Property

Type

Additional comments

Description

Example

Output

Object

Returns the label and value of a field fetched using OCR.

"Field1": "Date:2019.12.03 SAMSUNG SDS CORP.",

"Field2": "Request Number:#100000"

"Table": [{

"Field1": "DATE",

"Field2": "ITEM"

}]

※ For detailed examples, please refer to the note below.

Card input properties

Card properties
Common	Properties	Type	Required	Unit	Auto-setting	Description
Y	OCR	-	-	-	-	Common property of the Abbyy library.
Y	MORE OPTIONS	-	-	-	-	Common property of the Abbyy library.
Y	DESCRIPTION	-	-	-	-	Common property of the Abbyy library.

Example of utilization

Compare the image file (Invoice.JPG) with a template registered on the OCR server, extract the values in each field (Date, Item, Amount, Description) and store them to the variable (RESULT) and then output the data in a message box.

Excel_NewExcel_1K

Sample file

Menu > Help > Sample > Sample > Abbyy > Get Text > P_GetImageFieldData_Test

Used variables

RESULT: Variable to store the labels and values in the text strings after comparing them with data in each field of the template

Used properties

[Output] Output = this.result
[OCR] FilePath = Global.ResourcesDir + 'Invoice.JPG'
[OCR] Template = Invoice
[OCR] Language = All

Result by field based on the sample OCR image

The field names can be changed because the field values are assigned based on the template created on the Admin Portal.

• Text: result.field_name

result.Field1 -> Date:2019.12.03 SAMSUNG SDS CORP.

• Table: result.table_name(Column).field_name

result.Table(0).Field1 -> DATE

• result value

"Field1": "Date:2019.12.03 SAMSUNG SDS CORP.",

"Field2": "Request Number:#100000"

"Table": [

{

"Field1": "DATE",

"Field2": "ITEM",

"Field3": "AMOUNT",

"Field4": "DESCRIPTION"

{

"Field1": "2019.11.29",

"Field2": "ITEM A",

"Field3": "10",

"Field4": "DESC1"

{

"Field1": "2019.11.30",

"Field2": "ITEM B",

"Field3": "20",

"Field4": "DESC2"

{

"Field1": "2019.12.01",

"Field2": "ITEMC",

"Field3": "30",

"Field4": "DESC3"

{

"Field1": "2019.12.02",

"Field2": "ITEMD",

"Field3": "40",

"Field4": "DESC4"

}

Related/Similar activities

GetPDFFieldData

Overview

This activity card compares a specific image file with the template registered on the OCR portal and reads the labels and values of the predefined fields.

Application procedures

This activity card requires the OCR server for operation. Therefore, it can be operated only when you are logged in to the Designer account.

In the [Output] Output field, enter the variable to store the label and value of the field.
In the FilePath field, enter the path and name of the file that will be used to verify the label and value of the field.
In the Properties window, specify other required properties.

Card output properties

Property	Type	Additional comments	Description	Example
Output	Object	-	Returns the label and value of a field fetched using OCR.	"Field1": "Date:2019.12.03 SAMSUNG SDS CORP.", "Field2": "Request Number:#100000" "Table": [{ "Field1": "DATE", "Field2": "ITEM" }] ※ For detailed examples, please refer to the note below.

Property

Type

Additional comments

Description

Example

Output

Object

Returns the label and value of a field fetched using OCR.

"Field1": "Date:2019.12.03 SAMSUNG SDS CORP.",

"Field2": "Request Number:#100000"

"Table": [{

"Field1": "DATE",

"Field2": "ITEM"

}]

※ For detailed examples, please refer to the note below.

Card input properties

Card properties
Common	Properties	Type	Required	Unit	Auto-setting	Description
Y	OCR	-	-	-	-	Common property of the Abbyy library.
Y	MORE OPTIONS	-	-	-	-	Common property of the Abbyy library.
Y	DESCRIPTION	-	-	-	-	Common property of the Abbyy library.

Example of utilization

Compare the image file (Invoice.JPG) with a template registered on the OCR server, extract the values in each field (Date, Item, Amount, Description) and store them to the variable (RESULT) and then output the data in a message box.

Excel_NewExcel_1K

Sample file

Menu > Help > Sample > Sample > Abbyy > Get Text > P_GetPDFFieldData_Test

Used variables

RESULT = Variable to store the labels and values in the text strings after comparing them with data in each field of the template

Used properties

[Output] Output = this.result
FilePath = Global.ResourcesDir + 'Invoice.JPG'
Template = Invoice
Language = All

Result value for each field based on OCR sample image

Field names are also editable as field values are assigned based on the template created in AdminPortal.

• Text : result. field name

result.Field1 -> Date:2019.12.03 SAMSUNG SDS CORP.

• Table : result.Table name(Column).Field name

result.Table(0).Field1 -> DATE

• result value

"Field1": "Date:2019.12.03 SAMSUNG SDS CORP.",

"Field2": "Request Number:#100000"

"Table": [

{

"Field1": "DATE",

"Field2": "ITEM",

"Field3": "AMOUNT",

"Field4": "DESCRIPTION"

{

"Field1": "2019.11.29",

"Field2": "ITEM A",

"Field3": "10",

"Field4": "DESC1"

{

"Field1": "2019.11.30",

"Field2": "IT티VI B",

"Field3": "20",

"Field4": "DESC2"

{

"Field1": "2019.12.01",

"Field2": "ITEMC",

"Field3": "30",

"Field4": "DESC3"

{

"Field1": "2019.12.02",

"Field2": "ITEMD",

"Field3": "40",

"Field4": "DESC4"

}

Related/Similar activities

GetImageFieldData

TextClick

Overview

This activity card finds a specific text from an image and clicks it.

Application procedures

This activity card requires the OCR server for operation. Therefore, it can be operated only when you are logged in to the Designer account.

Double-click No Target on the activity card.
Specify the range of the target image to click.
In the [Output] Output field, enter the variable to store the execution result.
In the OCR properties, enter the scale of the original image size and the text to search.
In the Properties window, specify other required properties.

Card output properties

Property	Type	Additional comments	Description	Example
Output	String	-	Returns the result of performing OCR.	'Google'

Card input properties

Card properties
Common	Properties	Type	Required	Unit	Auto-setting	Description
N	Search Bounds	Text	N	-	Y	Specify the range of the screen to search for an image. The range will be automatically specified when you select a target. You can also change the range if needed.
N	Index	Text	N	-	N	Enter the number to choose a text string if there are multiple instances of the same text strings.
Y	IMAGE	-	-	-	-	Common property of the Abbyy library.
Y	OCR	-	-	-	-	Common property of the Abbyy library.
Y	MORE OPTIONS	-	-	-	-	Common property of the Abbyy library.
Y	DESCRIPTION	-	-	-	-	Common property of the Abbyy library.

Example of utilization

Open the Google website (www.google.com) with Chrome. When the Google logo image is displayed, click the specified image and search for the “Google” text string. Then, output the searched text string in a message box and close the Chrome browser.

Excel_NewExcel_1K

Sample file

Menu > Help > Sample > Sample > Abbyy > Abbyy_Mouse > P_TextClick_Test

Used variables

openBrowser = Variable to specify the launched browser
waitImage = Variable to store the verification result of whether the target image is displayed
textClick = Variable that stores the OCR operation result
textPoint = Variable that stores the range for the image search

Used properties

[Output] Output = this.textClick
Search Bounds = this.textPoint
Scale(%) = 100
Target Text = 'Google'

Related/Similar activities

TextDoubleClick, TextRightClick, TextHover

TextDoubleClick

Overview

This activity card finds a specific text from an image and double-clicks it.

Application procedures

This activity card requires the OCR server for operation. Therefore, it can be operated only when you are logged in to the Designer account.

Double-click No Target on the activity card.
Specify the range of the target image to double-click.
In the [Output] Output field, enter the variable to store the execution result.
In the OCR properties, enter the scale of the original image size and the text to search.
In the Properties window, specify other required properties.

Card output properties

Property	Type	Additional comments	Description	Example
Output	String	-	Returns the result of performing OCR.	'Google'

Card input properties

Card properties
Common	Properties	Type	Required	Unit	Auto-setting	Description
N	Search Bounds	Text	N	-	Y	Specify the range of the screen to search for an image. The range will be automatically specified when you select a target. You can also change the range if needed.
N	Index	Text	N	-	N	Enter the number to choose a text string if there are multiple instances of the same text strings.
Y	IMAGE	-	-	-	-	Common property of the ImageRecognition library.
Y	OCR	-	-	-	-	Common property of the ImageRecognition library.
Y	MORE OPTIONS	-	-	-	-	Common property of the ImageRecognition library.
Y	DESCRIPTION	-	-	-	-	Common property of the ImageRecognition library.

Example of utilization

Open the Google website (www.google.com) with Chrome. When the Google logo image is displayed, double-click the specified image and search for the “Google” text string. Then, output the searched text string in a message box and close the Chrome browser.

Excel_NewExcel_1K

Sample file

Menu > Help > Sample > Sample > Abbyy > Abbyy_Mouse > P_TextDoubleClick_Test

Used variables

openBrowser = Variable to specify the launched browser
waitImage = Variable to store the verification result of whether the target image is displayed
textDoubleClick = Variable that stores the OCR operation result
textPoint = Variable that stores the range for the image search

Used properties

[Output] Output = this.textDoubleClick
Search Bounds = this.textPoint
Scale(%) = 100
Target Text = 'Google'

Related/Similar activities

TextClick, TextRightClick, TextHover

TextRightClick

Overview

This activity card finds a specific text from an image and right-clicks it.

Application procedures

This activity card requires the OCR server for operation. Therefore, it can be operated only when you are logged in to the Designer account.

Double-click No Target on the activity card.
Specify the range of the target image to right-click.
In the [Output] Output field, enter the variable to store the execution result.
In the OCR properties, enter the scale of the original image size and the text to search.
In the Properties window, specify other required properties.

Card output properties

Property	Type	Additional comments	Description	Example
Output	String	-	Returns the result of performing OCR.	'Google'

Card input properties

Card properties
Common	Properties	Type	Required	Unit	Auto-setting	Description
N	Search Bounds	Text	N	-	Y	Specify the range of the screen to search for an image. The range will be automatically specified when you select a target. You can also change the range if needed.
N	Index	Text	N	-	N	Enter the number to choose a text string if there are multiple instances of the same text strings.
Y	IMAGE	-	-	-	-	Common property of the Abbyy library.
Y	OCR	-	-	-	-	Common property of the Abbyy library.
Y	MORE OPTIONS	-	-	-	-	Common property of the Abbyy library.
Y	DESCRIPTION	-	-	-	-	Common property of the Abbyy library.

Example of utilization

Open the Google website (www.google.com) with Chrome. When the Google logo image is displayed, right-click the specified image and search for the “Google” text string. Then, output the searched text string in a message box and close the Chrome browser.

Excel_NewExcel_1K

Sample file

Menu > Help > Sample > Sample > Abbyy > Mouse Action > P_TextRightClick_Test

Used variables

openBrowser = Variable to specify the launched browser
waitImage = Variable to store the verification result of whether the target image is displayed
textRightClick = Variable that stores the OCR operation result
textPoint = Variable that stores the range for the image search

Used properties

[Output] Output = this.textRightClick
Search Bounds = this.textPoint
Scale(%) = 100
Target Text = 'Google'

Related/Similar activities

TextClick, TextDoubleClick, TextHover

TextHover

Overview

This activity card finds a specific text from an image and hovers the mouse pointer over it.

Application procedures

This activity card requires the OCR server for operation. Therefore, it can be operated only when you are logged in to the Designer account.

Double-click No Target on the activity card.
Specify the range of the target object over which to hover the mouse pointer.
In the [Output] Output field, enter the variable to store the execution result.
In the OCR properties, enter the scale of the original image size and the text to search.
In the Properties window, specify other required properties.

Card output properties

Property	Type	Additional comments	Description	Example
Output	String	-	Returns the result of performing OCR.	'Google'

Card input properties

Card properties
Common	Properties	Type	Required	Unit	Auto-setting	Description
N	Search Bounds	Text	N	-	Y	Specify the range of the screen to search for an image. The range will be automatically specified when you select a target. You can also change the range if needed.
N	Index	Text	N	-	N	Enter the number to choose a text string if there are multiple instances of the same text strings.
Y	IMAGE	-	-	-	-	Common property of the Abbyy library.
Y	OCR	-	-	-	-	Common property of the Abbyy library.
Y	MORE OPTIONS	-	-	-	-	Common property of the Abbyy library.
Y	DESCRIPTION	-	-	-	-	Common property of the Abbyy library.

Example of utilization

Open the Google website (www.google.com) with Chrome. When the Google logo image is displayed, search for the “Google” text string and hover the mouse pointer over it. Then, output the searched text string in a message box and close the Chrome browser.

Excel_NewExcel_1K

Sample file

Menu > Help > Sample > Sample > Abbyy > Mouse Action > P_TextHover_Test

Used variables

openBrowser = Variable to specify the launched browser
waitImage = Variable to store the verification result of whether the target image is displayed
textHover = Variable that stores the OCR operation result
textPoint = Variable that stores the range for the image search

Used properties

[Output] Output = this.textHover
Search Bounds = this.textPoint
Scale(%) = 100
Target Text = 'Google'

Related/Similar activities

TextClick, TextDoubleClick, TextRightClick