No finish for activity:plug-in Filter In High-Frequency Traces (Single Log)

grezly

I'm currently trying to optimize my imported dataset (1,38 GB (1.491.709.404 bytes)).
The dataset contains 390337 casusses with 2621507 events.
I can use alsmost every action, excepted foor de filter inxx/filter log/filter out xxx-actions.
I can run for example the Filter In High-Frequency Traces (Single Log) (to 'optimize' my dataset). 
But from then Prom keeps +/- 25% CPU usage with almost all the time between 7 and 8 G memory usage. 

After 4 days of waiting there is still no progress (visible), and no new items are created in my main menu.

Below you can see the latest part of the log from Prom (Verbose=All), specific the latest line.

====

Start plug-in Open XES Log File (Disk-buffered by MapDB, sequential access)

End plug-in Open XES Log File (Disk-buffered by MapDB, sequential access), took 87796 milliseconds

[ActionsBrowser] setFocus

Start plug-in Filter Out Low-Occurrence Traces (Single Log)

End plug-in Filter Out Low-Occurrence Traces (Single Log), took 90654 milliseconds

Start plug-in @2 Log Summary

End plug-in @2 Log Summary, took 32669 milliseconds

[ActionsBrowser] setFocus

Start plug-in Filter Log on Trace Attribute Values

End plug-in Filter Log on Trace Attribute Values, took 107224 milliseconds

Start plug-in @2 Log Summary

End plug-in @2 Log Summary, took 32564 milliseconds

[ActionsBrowser] setFocus

Start plug-in Filter In High-Frequency Traces (Single Log)

Threshold = 570
====

After this there is no additional informatie show on the console, whil my cpu and memory is still occupied.
Below is the usage of my cpu en memory usage. As you seen there is no full usage of my resources.



Does any know experienced the same issue?
Update: Is it possible to get more verbose information from specific plug-ins? (on top of the verbose option within Prom)

hverbeek

Dear grezly,

This particular plug-in has a complexity that is at least quadratic in the number of traces (casusses). Given that your input log contains almost 400000 traces, you are in for a wait.

This plug-in was not developed with such a log in mind. It also does not provide any more diagnostic information.  

Some of the plug-ins may use logging frameworks, for which you can configure which messages you want to see, but most of them do not.

Kind regards,

Eric.

grezly

Thanks Eric for your reply.
Do you have a suggestion which filter/plugin/combination i can use to 'optimize'/minimize my dataset. (remove non frequent occurences  of traces)