Multiple time frame trading analysis -brianshannon.pdf
Identifying Candidate Routines for Robotic Process Automation From Unsegmented UI Logs
1. Identifying candidate routines for
Robotic Process Automation from
unsegmented UI logs
Volodymyr Leno, Adriano Augusto, Marlon Dumas,
Marcello La Rosa, Fabrizio Maria Maggi, Artem Polyvyanyy
2. 3
What is Robotic Process Automation (RPA)?
Robotic Process Automation – emerging technology that allows organizations to automate repetitive
clerical work by executing scripts (RPA bots) that encode sequences of fine-grained interactions with Web
and desktop applications
2
3. 33
How to identify candidates for automation?
Interviews Workshops Observation
Requires a lot of time
Information about routine can be incomplete
4. V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic
process automation. In Proceedings of Demonstration Track at BPM 2019, 124–128, 2019
Alternative: logging user interactions
4
5. Approach outline
UI Log
Preprocessing and
normalization
Control-flow graph
construction
Back Edges
detection
Segments
identification
Candidate
selection
Candidates
discovery
Candidate
routines
Segmentation
Routines identification
5
6. Preprocessing and normalization
Remove all data parameters Remove redundant actions
UI parameters
Data
parameters
• Copied content
• Cell value
• Field value
Context
parameters
• Field name
• Button label
• Spreadsheet
Unique value for each trace Same value for all traces
6
13. Routines identification
<U1, Uy, U2, U3, Ux, U4, Uz>
<U1, Uy, U2, Ux, U3, Uz, U4>
<U1, Ux, Uz, U2, U3, U4>
Solution:
Discover frequent patterns as usual
Rank them accordingly to a certain metric (e.g., length, frequency, coverage)
Select the best pattern and remove its occurrences from the segments
Repeat the procedure until no more frequent patterns left
11
14. Routines identification
<Uy, Ux, Uz>
<Uy, Ux, Uz>
<Ux, Uz>
<U1, Uy, U2, U3, Ux, U4, Uz>
<U1, Uy, U2, Ux, U3, Uz, U4>
<U1, Ux, Uz, U2, U3, U4>
Pattern1: {U1, U2, U3, U4}
Solution:
Discover frequent patterns as usual
Rank them accordingly to a certain metric (e.g., length, frequency, coverage)
Select the best pattern and remove its occurrences from the segments
Repeat the procedure until no more frequent patterns left
11
15. Routines identification
<Uy>
<Uy>
<>
<Uy, Ux, Uz>
<Uy, Ux, Uz>
<Ux, Uz>
<U1, Uy, U2, U3, Ux, U4, Uz>
<U1, Uy, U2, Ux, U3, Uz, U4>
<U1, Ux, Uz, U2, U3, U4>
Pattern1: {U1, U2, U3, U4} Pattern2: {Ux, Uz}
Solution:
Discover frequent patterns as usual
Rank them accordingly to a certain metric (e.g., length, frequency, coverage)
Select the best pattern and remove its occurrences from the segments
Repeat the procedure until no more frequent patterns left
11
16. Datasets
13
Synthetic logs 1
Supervised recording 2
Unsupervised recording
1 A. Bosco, A. Augusto, M. Dumas, M. La Rosa, and G. Fortino,
“Discovering automatable routines from user interaction logs,” in BPM
Forum. Springer, 2019.
2 We created four more logs by combining SR and
RT
19. Real-life logs
16
Scholarship allocation process
Different workers
93 min of work
53 cases handled
1202 actions recorded
20. Results: real-life logs
Scholarships 1:
Scholarships 2:
Segments: 35
Routines: 2
Routine variants: 5
Execution time: 41.686 sec
The second log describes more complex and unstructured behavior
Segments: 3
Routines: 0
Routine variants: 0
Execution time: 426.319 sec
17
21. Limitations and future work
18
The approach relies on data quality of the log
Requires expert knowledge to identify context parameters
Several variants of the same routine may be discovered (e.g., actions are in different order)
Routines recorded in the log should not overlap
All routine executions should start from the same action
Limitations
Devise a technique to automatically identify context parameters
Improve the approach to ease requirements to recorded routines
Add post-processing to remove redundant variants of routine
Future work
No “process” automation but “task” automation
Not “physical” robots but “software” robots
No “process” automation but “task” automation
Not “physical” robots but “software” robots
V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019
Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes
Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc.
In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019
Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes
Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc.
In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019
Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes
Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc.
In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019
Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes
Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc.
In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019
Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes
Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc.
In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019
Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes
Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc.
In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019
Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes
Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc.
In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019
Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes
Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc.
In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019
Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes
Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc.
In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019
Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes
Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc.
In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019
Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes
Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc.
In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019
Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes
Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc.
In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019
Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes
Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc.
In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019
Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes
Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc.
In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019
Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes
Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc.
In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019
Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes
Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc.
In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019
Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes
Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc.
In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet
V. Leno, A. Polyvyanyy, M. La Rosa, M. Dumas and F. Maria Maggi. Action logger: Enabling process mining for robotic process automation. In Proceedings of the Dissertation Award, Doctoral Consortium, and Demonstration Track at BPM 2019, 124–128, 2019
Available recording tools (e.g., WinParrot, JitBit) record low-level action only – clickstreams, keystrokes
Although RPA tools (e.g., UI Path, Automation Anywhere) provide recording capabilities they are focused on manual programming of scripts. They do not record values of involved fields, do not capture timestamps, etc.
In UI Path Studio, however, there is a component called UI Explorer, that is similar to our Action Logger, but it works only for Web (supports limited amount of actions), while our tool covers also Excel spreadsheet