Convenience features for development

Step Recorder

The Step Recorder is a tool that helps field employees conveniently make process automation requests to developers.
The time required for an RPA developer to fully understand the tasks of the person in charge can be drastically reduced through the step recorder. In addition, by recording the operation of the PC, the work process can be recorded and used as work design data.

After running the Step Recorder, a video recording file, recording project and an recorded event file are created.
Developers can view the work processes by referring to the two files and developing automated processes.

Taking advantage of the Step Recorder, field employees can minimize the time for documenting their requests, and RPA developers can reduce the time it takes to understand the work processes.

REC beg

To reduce the time it takes to design automated processes by utilizing Step Recorder, complete the following steps:
1 Recording the work process 
2 Referencing video files (Utilizing the Sync function)
3 Viewing the recorded event file
4 Real-time automatic correction after converting recorded events into processes

Recording the work process

Create a scenario of the user’s actions by clicking the step recording button. You can record actions, such as mouse-click, right-click, double-click, and keyboard input actions.

To design a project with a step recording function, complete the following steps:
  1. Access the C:\Users\UserName\AppData\Roaming\Brity RPA Designer folder in File Browser and double-click the BrityRPA_Recorder.exe file to run Step Recorder.

2. When Step Recording starts, use the recording menu that appears at the top of your PC screen to record your business actions.

REC 2

No.

Description

1

Enable recording.

2

Ends recording.

3

Step Recorder menus. You can configure Recording settings, Record Opt., and Exit the step recorder.


4 Real-time automatic correction after converting recorded events into processes

You can configure recording settings before starting recording.

Pause2

No.

Description

1

You can set whether or not to record a video.

2

Select the target screen for video recording.

3

Select the language to be used in the step recorder.

4

Select the output path to be created after the step recording is finished.

3. You can check the recording result in the recording folder under the default project path when the recording is finished.
4. C:\Users\사용자명\Documents\Brity RPA Recorder ProjectsUnder the folder 'RecordedPrj_(Year Month Date Hour Minute Second)'\RecorderData

REC 6

No.

File Name

Description

1

Record.proc

This process file maps the recorder's actions to the steps of Brity RPA Designer.

2

StepVideo.avi

This is a recorded video file.

Open recorded project file

1. On File Explorer, open the project file of "RecordedPrj_(Year Month Day Time Hour Minute Second)" folder under the C:\Users\UserName\Documents\Brity RPA Recorder Projects  through Brity RPA Designer.

If you specify the default project path in the recording settings, the project file exists under that path.

스텝레코더 프로젝트 폴더

2. Double-click the Record to open the tab and to check the recorded steps.

스텝레코더프로젝트폴더2

The Record process displays actions and targets on cards. In addition, the Record process must be converted into a normal process before it can be used for automation tasks (see Converting a Record process to a normal process).

No.

Description

1

Files created by the Step Recorder are organized in the Recorder Data folder.

2

Process files created by Step Recorder are read-only.

3

The target object of the step created by the step recorder has a Captured By property of Recorder .

Referencing video files (Utilizing the Sync feature)

You can open and check the recorded video file to check the action of the actual user.
Not only can the recorded video be played back, but you can check which step it is mapped to through the Sync function.

To utilize the Sync feature, complete the following steps:
  1. With the Record process tab open , click the Run button.

IPAV 파일 열기1

  1. In the Select Execution Type pop-up window, Click Play Record.

IPAV 파일 열기1

스텝레코더 리소스 열기

Converting a Record process to a normal process

The Record process is not a process that is directly used in actual automation work.
Therefore, it can only be used for automation when converted into a general process based on the recording process.
The designer completes the process by calibrating the target object in real time while executing the process created by the Record process.
To use Convert to Normal Process, complete the following steps.
  1. With the Record process tab open , click the Run button .

REC 8

2. In the Select Execution Type pop-up window, Click Create Process.

REC 9

3. In the process creation pop-up window, enter the name of the process to be created and click the Create button.

REC 11

4. Double-click the created process in the Project View to open the tab.

REC 12

5. With the Created Processes tab open , click the Run button .

REC 8

Since the target object recorded by the step recorder may be inaccurate, reassignment is in progress.

REC 13

The designer performs automatic correction if the recorded data and target are different during the scenario.

Debugging

If problems occur while running a scenario, you can switch to debugging mode to view the execution status, such as the variable values, at the process stop in the debugging console.

Adding a break point

You can add a break point in the following ways:
① Select an activity card and press F9.
② Right-click the activity card and click Add BreakPoint in the context menu.
After adding a breakpoint, the added breakpoint is indicated with a red line on the left border of the activity.
When you run a flow chart, the execution will stop at the place where the breaking points have been set. And in the bottom-right area of the canvas, the Debug - CallStack, Debug - Variables, and Debug - Command Window tabs will be displayed next to the Log tab.

디버깅화면

No.

Name

Shortcut

Description

1

Continue

F5

Continue to run the flow chart until the next breakingpoint. If another break point does not exist, the flow chart will be run to the end.

2

Enter into child process

F11

If sub-processes exist, proceed with debugging the sub-processes or tasks one by one. This feature is enabled only when breakpoints exist within the sub-processes or /tasks.

3

Run next step

F10

Move to the next step and continue debugging. Even when there are sub-processes or tasks, they will not be debugged.

4

Exit to parent process

Shift+F11

If you entered sub-processes or tasks by clinking the button, you can move back to the upper level process and continue debugging. This feature is enabled only when an upper level process or task exists.

Utilizing the debugging console

디버깅 콘솔

You can enter a variable name in the input field of the Debug - Command Window tab and press Enter or click Execute to display the value of the variable at the break point. You can also change the value of the variable in the Debug - Command Window tab.

Running process sections

You can efficiently debug the processes in the flow chart by running them by sections.

구간실행

No.

Name

Shortcut

Description

1

Run

F5

Run all processes or tasks.

2

Run step

F6

Run only the activity that is currently selected.

3

Run to here

F7

Run processes or tasks up to the selected activity.

4

Run from here

F8

Run processes or tasks from the selected activity to the end.

5

Run with stored variables

Ctrl + F8

This feature is enabled only if the previous run failed. You can restore the value of the used variable and run the processes with the variable value.

Custom library

You can utilize the custom library feature to define a user library in the project, or import an external library and use it like an internal library.

Creating a custom library

  1. In the Project window, right-click CUSTOM LIBRARIES and click New Custom Library.

커스텀라이브러리만들기

  1. In the "New Custom Library" pop-up window, specify the library type and enter description, and then click OK.

새 커스텀 라이브러리 팝업창

Library types

Type

Description

JavaScript

Using JavaScript, users compose only the body part of the library.

MS Workflow Activity

Import and utilize libraries based on MS Workflow Activity Framework. The library, the DLL file and all dependent files must be copied into the custom library folder in advance to import the library.

MS.NET Library

Import and utilize .Net Framework libraries. To import the library, the DLL file and all dependent files must be copied into the custom library folder in advance.

Creating a JavaScript library

Procedures for creating a JavaScript library

To create and utilize a JavaScript library, complete the following steps:
  1. In the Project window, right-click CUSTOM LIBRARIES and click New Custom Library.

  2. In the "New Custom Library" pop-up window, complete the following steps and click OK.

    1. Enter a name for the new custom library.

    2. Select JavaScript as the library type.

    3. Enter a description.

The created library file (.js) is saved in the “CustomLibraries” folder within the project folder.

- C:\Users\UserName\Documents\Brity RPA Projects\Projectname\CustomLibraries

Activity1

Example

Display the execution result of the input in the code window in a message box.

  1. In the Project window, double-click the newly created custom library under CUSTOM LIBRARIES and enter the body of the JavaScript function.

Activity1

  1. Add the custom library to the flow chart and specify the properties.

Activity1

No.

Description

1

Add a newly created custom library as an activity.

2

Enter "-1000" as the ARGUMENTS value of the CustomLibrary property.

3

Click Run.

4

“1000” is returned as the result of the MessageBox activity card.

Creating an MS Workflow Activity library

Procedures for creating an MS Workflow Activity

To create and utilize an MS Workflow Activity library, complete the following steps:
  1. Download an open library (activity).

  2. Change the extension of the downloaded file (.nupkg) to ".zip" and unzip it.

  3. Copy the library file (.dll) in the"lib" folder to the "CustomLibraries" folder.

    • Folder path: C:\Users\UserName\Documents\Brity RPA Projects\Projectname\CustomLibraries

  4. In the Project window, right-click CUSTOM LIBRARIES and click New Custom Library.

  5. In the "New Custom Library" pop-up window, complete the following steps and click CREATE.

    1. Enter a name for the new custom library.

    2. select MS Workflow Activity as the library type.

    3. Select the library saves in the CustomLibraries folder from the external library path.

    4. Select the activity class.

    5. Enter a description.

The created library file (.js) is saved in the “CustomLibraries” folder within the project folder.

- C:\Users\UserName\Documents\Brity RPA Projects\Projectname\CustomLibraries

Activity1

Example

Delete all data in the specified folder.

Activity1

No.

Description

1

Add the “Clear” library to the flow chart.

2

Enter the name of the folder to delete data in the Path field.

3

Click Run. (All data in the folder will be deleted but the folder itself will not be deleted.)

Activity1

Creating an MS .NET library

Procedures for creating an MS .NET library

To create and utilize an MS .NET library, complete the following steps:
  1. Download the .NET Assembly (C# based library) library.

  2. Change the extension of the downloaded file (.nupkg) to ".zip" and unzip it.

    • Folder path: C:\Users\UserName\Documents\Brity RPA Projects\Projectname\CustomLibraries

  3. In the Project window, right-click CUSTOM LIBRARIES and click New Custom Library.

  4. In the "New Custom Library" pop-up window, complete the following steps and click CREATE.

    1. Enter a name for the new custom library.

    2. Select MS .NET library as the library type.

    3. Select the library saves in the CustomLibraries folder from the external library path.

    4. Select the activity class.

    5. Select the method.

    6. Specify whether to construct an instance.

      • Check: Display constructors of the selected class and create an Instance Constructor library.

      • Uncheck: Select the Public method (including Static method) within the selected class, create the library, and call the Default constructor upon execution.

- C:\Users\UserName\Documents\Brity RPA Projects\Projectname\CustomLibraries.

Activity1

Example

Unzip the archive in a specified folder.

  1. Download the “Ionix.zip” file.(https://www.nuget.org/packages/Ionic.Zip/1.9.1.8)

  2. Change the extension of the downloaded file (.nupkg) to ".zip" and unzip it.

  3. Copy the library file (.dll) in the"lib" folder to the "CustomLibraries" folder.

    • Folder path: C:\Users\UserName\Documents\Brity RPA Projects\Projectname\CustomLibraries .

Activity1

  1. Add the library for selecting the archive file to unzip to the flow chart and specify the properties.

Activity1

No.

Description

1

Add the ZipFile_Instance activity card to the flow chart.

2

Enter the archive file name (.zip) in the fileName field.

3

Enter the instance variable in the Result field.

  1. Add the library for storing the unzipped archive data to the flow chart and specify the properties.

Activity1

No.

Description

1

Add the ZipFile_ExtractAll activity card to the flow chart.

2

Enter the extraction path in the path field.

3

Enter the instance variable in the Instance field of the Properties window.

4

Click Run.

Activity1

Add-in library

You can create an Add-in library on MS Visual Studio. Create the Add-in library by developing and adding a Designer library, or create an activity card in the library.

Procedures for creating an Add-In library

Procedures for creating an Add-In library and configuring the work environment are as follows:
  1. Creating a Visual Studio Project.

    • Version: Visual Studio 2017

    • Project type: Class library (.NET Framework, Visual c#)

      • File > New > Project > Installed > Visual C#

      • Framework: .NET Framework 4.5

    • Project name: BrityWorks.AddIn.[ProjectName]

Activity1

  1. Configure the VisualStudio project properties.

Activity1

Activity1

Activity1

  1. Add references.

    • Project > Add Reference > Assemblies, Search .

    • WindowsBase, PresentationCore, PresentationFramework.

Activity1

Activity1

Activity1

  1. Configure the debugging environment.

Activity1

Set the "PlayInBOT" property to ON after the development is complete. The Designer can be stopped or terminated abnormally due to flaws in the activity codes, Windows object recognition malfunctions, or system errors. In contrast, the PlayInBOT property is set to OFF.

  1. Implement the add-In.

Activity1

AddIn Class Implementation

Description

1

Implement the AddIn Class.

- Keep the class name as “AddIn.”

- Inherit [object Text][object Text][object Text]RPAGo.AddIn.ActivityAddInBase.

2

Implement the “abstract” item of ActivityAddInBase.

- Automatically populate the default code.

(Alt+Enter & Implement Abstract Class).

Activity1

- AddInDisplayName
- AddInIcon
- AddInOverIcon
- CreateActivities()
  1. Implement the activity declarative.

Activity1

Activity1

Activity1

Activity declarative

Description

1

Add the activity class.

- Add a class in Project > Activities.

- inherit the RPAGO.AddIn.IActivityItem interface.

- Generate the default code for the IActivityItem interface (Alt+Enter & Implement interface).

2

Define the Property List of the activity.

- Define the properties displayed on the Designer Property window.

- Define PropKey by property (PropertyGroup Name, Property Name)

- GroupName_PropertyName is the unique value.

  • Set the detailed specification by property in OnCreateProperties().

3

Implement activity information.

- DisplayName: The activity name displayed on the library view and activity card

- Icon: Activity icon

- Mode: BackgroundOnly (for headless projects only), ForegroundOnly (for regular projects only), Both (for both headless and regular projects)

DisplayTextProperty: The representative property to display on the activity card.

OutputProperty: Object to set as Output within properties.

  1. Implement the OnCreateProperties.

Activity1

  1. Implement activity execution.

Activity1

  1. Implement the OnRun.

    • The value entered in the Properties window for the property declared in OnCreateProperties is entered as the “Dictionary” type.

    • Implement the required action using the PropKey (String) as a key to obtain the value.

    • If the OutputProperty is defined (not null), set the return value of the OnRun. (Without the value, null will be returned.)

  1. Set the multilingual string resource.

Activity1

Setting the multilingual string resource.

Description

1

Create string resource files by language.

- Create String-[LanguageCode].xml under the Project/Resources/String folder.

2

Set the resource for Message output (Title * Contents)

3

Set the resource for display on the Property view

4

Set the resource for Property Description (ToolTip Help Description)

  • Enter the Key format of the string resource in the specified form, as shown in the example above.

Activity1

Refer to the example of an add-in library on MS Visual Studio.


- Download sample project

(This sample project is created based on MS Visual Studio 2017.)

API integration

Brity RPA provides an interface for API integration with external systems.

You can utilize the SendRequest activity card in the Net library to call RestAPIs via the HTTP protocol and implement interfaces with external systems.
For more information about using the activity card for integration, see SendRequest in the Net library.

Inspector

The Inspector is a tool that helps you specifically identify what you want to automate. You can view all or part of the application in a tree-like structure and analyze native apps, text extracted from images (OCR), and screen analysis of Android devices. With the Inspector, business managers can better understand the details and structure of their audience and reduce the time it takes to create scenarios.

Inspector Default Configuration

The Inspector is provided as a separate program and can be launched in the Designer by selecting the Tools > Inspector menu or IPA in the Brity RPA Designer installation path. You can double-click .exe Inspector to run it.

Inspector screen overview

인스펙터는 아래와 같은 화면 요소로 구성되어 있습니다.

Inspector1

No.

Description

1

The toolbar provides new files, opening, saving, analyzing text, copying activities, searching, and analyzing.

2

The screen window provides hierarchical information on the analyzed target. When you select an item, you can see its location on the canvas.

3

The XML window provides hierarchical information about the analyzed target in the form of XML. You can check the complete property information of each item in raw form.

4

The canvas window displays a screenshot image of the analyzed target. When you select a specific item, the location information of that object is displayed, and you can check its location in the screen window.

5

The Properties window displays the details of the selected item. You can copy the attribute value through the Copy button.

Basic Features of Inspector

The Inspector analyzes the automation targets you specify and displays the results. Depending on the option, the whole or part of the application can be analyzed. Native App analysis or OCR analysis that recognizes text from images can be considered for objects for which object recognition is not possible in the usual way. Screen information analysis of mobile terminals is also possible.

Application Analysis

By analyzing the structure of the entire application and organizing it in a tree form, you can understand the hierarchical relationship between objects. You can check information such as control type, class, area, name, value, text, and object path of a specific object.

Analyzing your application

  1. Change the method to Application on the Inspector screen and click the Inspect button.

Inspector2

  1. Hover to the application you want to analyze, and click on the orange rectangle. The entire application, including the selected area, is analyzed.

Inspector3

  1. The results of the analysis will be displayed on the screen. The analysis may take some time if the application is complex at scale.

Inspector3

Target Analysis

Analyze the structure of specific objects and subordinates within the application. The information in the verifiable object is the same as in the application analysis.

Analyzing your audience

  1. Change the method to Target on the Inspector screen and click the Inspect button.

Target_1

  1. Within the application, hover over the specific object you want to analyze; click when you see an orange square. Currently, the objects and subobjects in the selected area are analyzed.

Inspector3

  1. The analysis results will be displayed on the screen in a while.

Inspector5

Native App 분석

Analyze text information and regions for specific objects within native applications. Native libraries make it easy to identify areas that can be automated.

Analyzing Native Apps

  1. Change the method to Native on the Inspector screen and click the Inspect button.

Native

  1. Within the native application, hover over the specific object you want to analyze; click when you see an orange square. Currently, the objects and subobjects in the selected area are analyzed.

  1. The analysis results will be displayed on the screen in a while.

OCR Analysis

Recognize text from images of specific objects within the application. You can check the area that contains each text and the recognized text information.

Analyzing OCR

  1. Change the method to OCR on the Inspector screen and click the Inspect button.

OCR

  1. Within the OCR application, hover over the specific object you want to analyze; click when you see an orange square. Currently, the objects and subobjects in the selected area are analyzed.

OCR_Inspector

  1. The analysis results will be displayed on the screen in a while.

OCR_Inspector2

Android Analysis

It analyzes the screen information of the connected Android device. You can check information such as control type, class, text, area, package, XPath, etc.

Install ADB Tool for Android analysis.

- Installing ADB Tool

Analyzing Android

  1. Connect your Android device to your PC and change the mode to Android on the Inspector screen. Select the device you want to analyze from the automatically viewed list, and then click the Analysis button.

Android_Inspector1

  1. The analysis results will be displayed on the screen in a while.

Android_Inspector2

Inspector Convenience Features

The Inspector provides convenience functions to identify the system structure to be automated and to create scenarios more diversely and conveniently.

Extracting text

You can extract text from the analyzed screen image by specifying an area. The extracted text is displayed on the screen in the same form as the OCR analysis, along with the area information within the image.

The text extraction function recognizes text using OCR from the target image to be applied to all analysis results such as application, target, native app, OCR, Android, etc.

Extracting Text

  1. Change the method to Application on the Inspector screen and click the Analyze button. It is okay to proceed with the analysis in a way other than the Application.

Application_Inspector

  1. Hover over the application you want to analyze, and click on the orange rectangle.

Application_Inspector2

  1. The analysis results will be displayed on the screen in a while.

Application_Inspector3

  1. Select the target from which you want to extract text on the canvas.

Application_Inspector4

  1. Click on the menu in the toolbar text.

Application_Inspector5

  1. Select the detailed area from which you want to extract the text, and then select the Cut and Apply buttons in that order. Select the Apply button immediately if you want to use the area as it was for the first time.

Application_Inspector5

  1. The text extraction result for the selected area will be displayed on the screen after a while.

Application_Inspector6

Copying Activity

After selecting the desired object from the analysis result, use the activity copy function to copy the completed activity automatically. The copied activity can be pasted and executed directly by the designer. Depending on the analysis method, at least one activity required to perform the automation is copied, and all attributes are automatically entered.

Copying an activity

  1. Analyze your audience in the way you want on the Inspector screen first.

Copying_Inspector

  1. Select the target you want to copy to on the canvas.

Copying_Inspector2

  1. In the toolbar, Copy an activity. Click on the menu. To create the activity, the application to be analyzed must be running without being terminated to obtain the information necessary.

Copying_Inspector3

  1. A message is shown stating that the activity copy was done correctly.

Copying_Inspector4

  1. Run the designer and paste the copied activity. Depending on the analysis method, the number of activities may vary.

Copying_Inspector5

  1. If you want to change the object, Change Activity Menus are available.

Copying_Inspector6

Search

You can search for specific objects in the analysis results. A list of results appears for elements containing the entered text by querying all the object's properties, including the control type. The object is displayed on the screen or canvas when you select a specific item.

검색 기능 사용하기

  1. Analyze your audience in the way you want on the Inspector screen first.

Search_Inspector

  1. Click on the menu in the toolbar search.

Search_Inspector2

  1. After entering a search term in the search bar magnifying glass, Click the button.

Search_Inspector3

  1. Selecting a specific item in the search results syncs to the canvas to see the destination.

Search_Inspector4

Storing Object

Object storage is a storage vault that stores previously recognized objects when creating processes and tasks in the designer to reuse them.
Object storage can be used by importing stored storage files from other projects.
You can also copy and paste saved objects into Activities or search the list of activities where objects in the repository are used.

Currently, the objects that can be stored in the object store are App, SAP, ImageRecognition, and Abbyy library objects.

Object

Storing objects in an object store

Object2

To save an object to the object store, follow the below steps:

1. Import an object repository from another project.
2. Save all objects in the current process.
3. Save the selected object in the current process to save objects to the repository.

The context menu above appears when you right-click the root of the object store or right-click on the group.

Manipulating Objects Stored in Object Store

Object3

Manipulating objects stored in the object repository is as follows:

1. Changing the name. (Duplicate allowed)
2. Copying the objects. (You can paste objects into activities in the same library)
3. Search for activities where this object has been used in the current process.
4. Search for activities where this object has been used in all processes.
5. Delete.

The context menu above appears when you right-click on the object.
The names of objects stored in the object repository are initially randomly generated.

Search_Inspector4

The search results are displayed as shown above when you search for an activity where an object is used.