Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Long time taken for the Multivariate Anomaly Detection #594

Open
waqarkoc opened this issue Dec 3, 2024 · 1 comment
Open

Long time taken for the Multivariate Anomaly Detection #594

waqarkoc opened this issue Dec 3, 2024 · 1 comment
Labels
question Further information is requested

Comments

@waqarkoc
Copy link

waqarkoc commented Dec 3, 2024

  • Orion version:
  • Python version:
  • Operating System: Google Colab

Description

I have 5 columns dataset https://github.com/microsoft/fabric-samples/blob/main/docs-samples/real-time-intelligence/demo_stocks_change.csv . It takes alot of time for detecting anomalies

I have following code to run Anomalies

from orion.data import load_signal

signal_path = '/content/demo_stocks_change.csv'
import pandas as pd
df = pd.read_csv(signal_path)
df.rename(columns={'Date': 'timestamp'}, inplace=True)
df['timestamp'] = pd.to_datetime(df['timestamp'])
from orion import Orion

hyperparameters = {
    "mlstars.custom.timeseries_preprocessing.time_segments_aggregate#1": {
        'interval': 1
    },
    'orion.primitives.aer.AER#1': {
        'epochs': 5,
        'verbose': True
    }
}

orion = Orion(
    pipeline='aer',
    hyperparameters=hyperparameters
)

orion.fit(df)

It takes more than 1 hour but I can not see any epoch progress in the output

@sarahmish
Copy link
Collaborator

Thank you @waqarkoc for using Orion!

It might be a large dataset, can you try to see if you limit the length of df to somewhere around a thousand entries, do you see the progress bar?

@sarahmish sarahmish added the question Further information is requested label Dec 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants