Deep learning based time series classification in aeon

There are a range of deep learning based classification algorithms in the toolkit. The networks that are common to classification, regression and clustering are in the networks module. Our deep learning classifiers are based those used in deep learning bake off [1] and recent experimentation [2]. [3] provides an extensive recent review of related deep learning work.

A list of all deep learning classifiers

import warnings

from aeon.registry import all_estimators

warnings.filterwarnings("ignore")
all_estimators("classifier", filter_tags={"algorithm_type": "deeplearning"})

[('CNNClassifier', aeon.classification.deep_learning.cnn.CNNClassifier),
 ('EncoderClassifier',
  aeon.classification.deep_learning.encoder.EncoderClassifier),
 ('FCNClassifier', aeon.classification.deep_learning.fcn.FCNClassifier),
 ('IndividualInceptionClassifier',
  aeon.classification.deep_learning.inception_time.IndividualInceptionClassifier),
 ('MLPClassifier', aeon.classification.deep_learning.mlp.MLPClassifier),
 ('ResNetClassifier',
  aeon.classification.deep_learning.resnet.ResNetClassifier),
 ('TapNetClassifier',
  aeon.classification.deep_learning.tapnet.TapNetClassifier)]

he use case for deep learning classifiers is identical to that of all classifiers. However, you need to have tensorflow installed in your environment. If you have a GPU correctly installed the classifiers should use them, although it is worth checking the output.

from sklearn.metrics import accuracy_score

from aeon.classification.deep_learning import CNNClassifier
from aeon.datasets import load_basic_motions  # multivariate dataset
from aeon.datasets import load_italy_power_demand  # univariate dataset

italy, italy_labels = load_italy_power_demand(split="train")
italy_test, italy_test_labels = load_italy_power_demand(split="test")
motions, motions_labels = load_basic_motions(split="train")
motions_test, motions_test_labels = load_basic_motions(split="train")
cnn = CNNClassifier()
cnn.fit(italy, italy_labels)
y_pred = cnn.predict(italy_test)
accuracy_score(italy_test_labels, y_pred)

(67, 1, 24)

Classifier Details

The deep learning bake off [1] found that the Residual Network (ResNet) was the best performing architecture for TSC. ResNet has the following network structure.

The InceptionTime deep learning algorithm Subsequent to [1], InceptionTime is an ensemble of five SingleInceptionTime deep learning classifiers. Each base classifier shares the same architecture based on Inception modules. Diversity is achieved through randomly intialising weights. A SingleInceptionTimeClassifier has the following structure.

A SingleInceptionTimeClassifier is structured as follows.

References

[1] Fawaz et al. (2019) “Deep learning for time series classification: a review” Data Mining and Knowledge Discovery. 33(4): 917-963

[2] Fawaz et al. (2020) “InceptionTime: finding AlexNet for time series classification. Data Mining and Knowledge Discovery. 34(6): 1936-1962

[3] Foumani et al. (2023) “Deep Learning for Time Series Classification and Extrinsic Regression: A Current Survey” ArXiv https://arxiv.org/pdf/2302.02515.pdf

[4] https://github.com/MSD-IRIMAS/CF-4-TSC

---

Generated using nbsphinx. The Jupyter notebook can be found here.