Vibration Signal Processing and Anomaly Detection Dashboard

0 Comments
Share This
Share This

Vibration Signal Processing and Anomaly Detection Dashboard

 

Vibration signal processing is the analysis of sensor data from rotating machinery, using tools like FFT, PSD, and STFT, to detect mechanical faults before they cause failure. Pairing these techniques with machine learning anomaly detection, such as Isolation Forest and PCA, makes it possible to flag imbalance, misalignment, and bearing wear automatically. Typically, our posts are for educational purposes, but in this post we talk specifically about using enDAQ sensors and enDAQ sensor data to help with signal processing. In this guide, you'll learn how to explore enDAQ vibration data (.ide files) and use an interactive dashboard to visualize signals, run frequency analysis, and detect anomalies, helping you reduce downtime and move toward predictive maintenance.  

Contents

  1. Introduction: Why Vibration Data Matters

  2. Exploring the Data

    - Time-Series Visualization

    - Histograms and Data Distribution

    - Data Drift and Statistical Metric

    - Frequency-Domain Analysis: FFT and PS

    - Time–Frequency Analysis: STFT

  3. Advanced Methods: Machine Learning for Anomaly Detectio

    - Principal Component Analysis (PCA)

    - Isolation Fores

    - Other Advanced Models

  4. Dashboard Overview: Interactive Vibration Analysi

    - Sidebar: Control Panel

    - Tabs: Organized Analysis Views

  5. How to Use the Dashboard

  6. Example Workflow

  7. Final Thoughts: The Importance of High-Quality Vibration Data

Introduction: Why Vibration Data

Vibration data is one of the most powerful signals for understanding the health and behavior of mechanical systems. Rotating machinery, such as motors, pumps, gearboxes, and fans, naturally produces vibration during operation. When something begins to degrade, that vibration signature changes, often long before a failure becomes visible or catastrophic.

For example, a small imbalance in a rotating shaft may introduce a dominant frequency component at the rotational speed. Misalignment between coupled shafts can generate harmonic patterns, while bearing defects often produce high-frequency impacts that grow over time. Even looseness in mounting structures can create nonlinear vibration behavior.

The key advantage of vibration analysis is early fault detection. Instead of reacting to failures, engineers can monitor trends and intervene proactively. This reduces downtime, lowers maintenance costs, and improves safety.

However, extracting useful insights from vibration data requires a combination of signal processing, statistical analysis, and increasingly, machine learning techniques. This blog introduces an interactive dashboard for vibration signal processing, enabling users to visualize raw data, histograms, and key statistical metrics; perform FFT and PSD analysis; and apply machine learning models such as Isolation Forest (IF) and PCA to detect anomalies in vibration signals collected by enDAQ sensors.


Exploring the Data

The first step in any vibration analysis workflow is understanding the raw data (for more details read the blog “How to Preprocess Vibration Data for Machine Learning (Step-by-Step Guide)” here.

 Time-Series Visualization 

Plotting raw acceleration signals over time provides immediate intuition about system behavior. You can observe:

    • Transient events
    • Periodic oscillations
    • Noise levels
    • Sudden spikes or impacts

Even simple smoothing (e.g., moving averages) can help reveal underlying patterns.

Histograms and Data Distribution

Histograms show how vibration amplitudes are distributed. A healthy system often exhibits a relatively stable distribution, while faults may:

    • Increase spread (higher variance)
    • Introduce skewness
    • Create heavy tails (extreme values)

Data Drift and Statistical Metrics 

Tracking statistical features over time is essential for condition monitoring:

    • Mean
    • Standard deviation
    • RMS (Root Mean Square)
    • Peak-to-peak values

Changes in these metrics can indicate evolving faults. For instance, a gradual increase in RMS vibration is often associated with wear or imbalance.

Frequency-Domain Analysis: FFT and PSD

While time-domain analysis is useful, many mechanical phenomena are better understood in the frequency domain.

Fast Fourier Transform (FFT)

FFT converts a time signal into its frequency components. This allows you to identify dominant vibration frequencies and link them to physical sources:

    • Rotational speed → fundamental frequency
    • Gear mesh → higher-frequency components
    • Bearing defects → characteristic fault frequencies

FFT is especially useful for diagnosing periodic behavior.

Power Spectral Density (PSD)

PSD provides a more stable representation of signal energy across frequencies. It is particularly useful when:

    • Signals are noisy
    • Long-term averaging is needed
    • Comparing energy levels across datasets

Together, FFT and PSD provide a deeper understanding of machine dynamics and help isolate fault signatures.

Time–Frequency Analysis: STFT

Some faults are not stationary, they evolve over time. This is where Short-Time Fourier Transform (STFT) becomes valuable.

STFT creates a spectrogram, showing how frequency content changes over time. This is useful for:

    • Detecting transient events
    • Identifying intermittent faults
    • Monitoring startup/shutdown behavior

Advanced Methods: Machine Learning for Anomaly Detection

As systems become more complex, traditional methods may not capture subtle or multidimensional patterns. Machine learning offers powerful alternatives (read the blog “Detecting Anomalies in Belt-Driven Systems with Machine Learning” here for deeper details on ML for anomaly detection).

Principal Component Analysis (PCA)

PCA reduces data dimensionality while preserving key variance. In vibration analysis:

    • It captures dominant motion patterns
    • Reconstructs signals
    • Flags anomalies based on reconstruction error

Isolation Forest

Isolation Forest is an unsupervised algorithm designed to detect anomalies by isolating rare patterns in data. It works well for:

    • High-dimensional signals
    • Large datasets
    • Unknown fault conditions

Other Advanced Models

Beyond PCA and Isolation Forest, more sophisticated approaches include:

    • LSTM (Long Short-Term Memory) for time-series prediction
    • Autoencoders (AE) for deep anomaly detection
    • Hybrid physics-informed ML models

Dashboard Overview: Interactive Vibration Analysis

These methods enable predictive maintenance and intelligent diagnostics.

To bring all these methods together, the provided dashboard offers an intuitive interface for vibration analysis. In this section, uploading ide file and exploring different sections of the dashboard is explained. To do this, navigate to the dashboard link, click on the “Upload” box, and select your IDE file (a sample ide file is provided in download section at the end of this blog). For optimal performance, it is recommended to use a smaller IDE file to avoid time-consuming analysis during the machine learning–based anomaly detection process.

After uploading the IDE file, a sidebar will appear where the user can adjust the parameters. By moving the cursor over the “?”, a tooltip will display an explanation of each parameter. All sidebar parameters are described in detail in the section below.

Dashboard Link

Sidebar: Control Panel

The sidebar is the control center of the dashboard, allowing users to configure analysis parameters:

Table 1: Dashboard Sidebar Parameters
Parameter Group Dashboard View

Time Window Selection

  • Define start and end times for analysis (Maximum span is 40 s to keep processing fast).
Dashboard sidebar Time Window Selection controls for setting the start and end times of the analysis

Sampling Settings

  • Automatically detect sampling frequency
    • Option to manually override (Check to manually set the sampling frequency.)
Dashboard sidebar Sampling Settings with automatic sampling frequency detection and a manual override checkbox

FFT Configuration

  • MA Window: Moving average window length (samples). Larger values smooth the time-series more but reduce temporal resolution.
  • Averaging: Average the FFT magnitude across multiple overlapping segments (Welch-style). Reduces variance at the cost of frequency resolution.
  • Overlap: Enable 50% overlap between consecutive FFT segments. Increases the number of averages and smooths the spectrum.
Dashboard sidebar FFT Configuration with moving average window, averaging and overlap options

Peak Detection

  • Min Height: Minimum FFT amplitude for a point to be considered a peak. Raise this to suppress low-amplitude noise peaks.
  • Min Distance: Minimum number of frequency bins between two detected peaks. Prevents multiple markers on a single broad peak.
  • Min Prominence: How much a peak must stand out from surrounding baseline. Higher values keep only the most dominant peaks.
Dashboard sidebar Peak Detection settings for minimum height, minimum distance and minimum prominence

PSD Settings

  • Nperseg: Length of each segment used in Welch's PSD estimate. Larger values give finer frequency resolution but more variance.
Dashboard sidebar PSD Settings with the Nperseg segment length input for Welch's PSD estimate

STFT Parameters

  • STFT Window size: Number of samples per STFT frame. Larger → better frequency resolution, coarser time resolution.
  • STFT Overlap %: Percentage of overlap between consecutive STFT frames. Higher overlap gives smoother time axis in the spectrogram.
Dashboard sidebar STFT Parameters for window size and overlap percentage used in the spectrogram

Anomaly Detection

  • Model: Isolation Forest isolates anomalies by randomly partitioning data — efficient for high-dimensional data. PCA reconstructs data and flags points with high reconstruction error.
  • Contamination: Expected fraction of anomalies in the data. A higher value flags more points as anomalous. Typical range: 0.001–0.05.
  • RMS Threshold: Pre-filter: only keep time-windows whose RMS exceeds this percentile of the overall RMS distribution. Removes near-zero (idle) segments before anomaly detection.
Dashboard sidebar Anomaly Detection settings for model selection, contamination and RMS threshold
  • Axis: Which acceleration axis to display in the anomaly plot. 'All' overlays all three axes.
Dashboard sidebar Axis selector for choosing which acceleration axis to display in the anomaly plot
Dashboard sidebar parameter groups (time window, sampling, FFT, peak detection, PSD, STFT and anomaly detection) and the corresponding dashboard controls used to configure the vibration analysis.

Tabs: Organized Analysis Views

The dashboard is divided into multiple tabs, each focusing on a specific aspect:

    • Time Series
      • Raw acceleration signals (X, Y, Z axes)
      • Immediate visualization of system behavior
    • Statistics
      • Histograms of vibration amplitude
      • Key statistical metrics table
    • FFT / PSD
      • Frequency spectrum with peak detection
      • Power spectral density plots
    • Time–Frequency
      • STFT spectrogram for dynamic analysis
    • Anomaly Detection
      • Machine learning-based anomaly identification
      • Visualization of detected abnormal points

How to Use the Dashboard

    • Upload an .ide file (enDAQ format)
    • Adjust parameters in the sidebar
    • Explore each tab for different insights
    • Run anomaly detection to identify unusual behavior

Example Workflow

A sample dataset was collected by mounting an enDAQ sensor on a belt-driven machine, with the Z-axis oriented normal to the ground (Fig. 1). The data was recorded over a 15-second interval, during which five controlled impacts were applied to the machine frame using a pen to simulate anomalies. This dataset, provided as an IDE file, is used throughout the blog to demonstrate and walk through the features of the dashboard.

Figure 1
Figure 1: Belt drive machine used for collecting vibration signals.

Once an .ide file is uploaded:

    • The system automatically extracts acceleration data
    • Sampling frequency is estimated
    • Signals are preprocessed (e.g., detrending)

Step-by-Step Interpretation

    • Time Series Tab
      • Observe signal stability and periodicity
    • Statistics Tab
      • Check RMS and variance for abnormal increases
    • FFT / PSD Tab
      • Identify dominant frequencies and harmonics
    • STFT Tab
      • Detect time-varying frequency behavior
    • Anomaly Tab
      • Highlight segments flagged as abnormal
      • Compare model outputs (PCA vs Isolation Forest)
Figure 2
Figure 2: Vibration signals along X, Y, and Z axis.

The time‑series plot clearly shows five high‑energy impact events across the X, Y, and Z acceleration channels, each producing sharp spikes that rise well above the baseline vibration level. Between impacts, the system remains stable with minimal variation, reflecting normal steady‑state behavior of the belt‑drive setup. The consistency of the spike shapes across axes indicates that each impact introduces a similar mechanical disturbance. Overall, the plot provides a clean visual separation between regular operation and externally induced shocks.

 

Figure 3
Figure 3: Histograms and statistical metrics of vibration signals for X, Y, and Z axis.

The amplitude distribution histogram shows that all three acceleration axes follow a roughly bell‑shaped pattern, with most vibration values concentrated near zero and gradually tapering toward the extremes. The Z‑axis displays noticeably wider spread and heavier tails, which is confirmed by its higher standard deviation and peak‑to‑peak value in the table. Meanwhile, the X and Y axes remain more tightly clustered, indicating more stable baseline motion in those directions. The statistical metrics reinforce these observations, highlighting how the Z‑axis captures the strongest variations and is most sensitive to impact‑driven disturbances in the system. Overall, the combined plot and table provide a clear overview of how vibration energy is distributed across the three axes during operation.

 

Figure 4
Figure 4: FFT (top) and PSD (bottom) analysis of vibration signals.

The FFT spectrum in the Z direction shows two clear dominant peaks, which can be attributed to the drive and driven pulleys of the belt system. The amplitude differences across the X, Y, and Z axes highlight directional sensitivity, with the Z-axis exhibiting the highest energy concentration due to its alignment normal to the machine frame. In the PSD plot, most of the signal energy is concentrated at lower frequencies, followed by a gradual decay, which is typical for vibration responses dominated by fundamental modes and their harmonics. The presence of these distinct peaks in both FFT and PSD indicates structured, repeatable behavior rather than random noise, while any additional broadband content may be associated with the induced impacts or other transient anomalies.

Figure 5
Figure 5: STFT analysis of vibration signals.

The spectrogram of the belt‑drive system shows a steady tonal band near the lower‑mid frequencies, representing the continuous rotational motion of the belt. Five distinct vertical bursts appear between roughly 4 and 7 seconds, each corresponding to an intentional impact made on the frame. These transients inject broadband energy momentarily, standing out clearly against the otherwise stable operating signature. Overall, the plot highlights how external mechanical shocks contrast sharply with the system’s normal, steady‑state vibration pattern.

PCA:

Figure 6
Figure 6: Anomaly detection using PCA analysis for Z direction (contamination factor=0.002).

The PCA‑based anomaly detection highlights 73 anomalies in the Z‑direction, supported by a high explained variance of about 0.97, showing that the reduced components preserve most of the vibration behavior. The anomalies align closely with the five intentional impacts, forming tight clusters around these high‑energy events. This indicates that PCA is more selective, emphasizing broader structural deviations rather than small, isolated spikes. As a result, it offers a more conservative but stable view of abnormal behavior, making it well‑suited for detecting consistent pattern changes caused by repeated impacts.

Isolation Forest:

Figure 7
Figure 7: Anomaly detection using Isolation Forest for Z direction (contamination factor=0.002).

The anomaly plot highlights how the Isolation Forest model responds to the five intentional impacts introduced into the belt‑drive system. While it successfully identifies the main shock events, it also flags numerous smaller fluctuations around them, resulting in a much higher anomaly count. This reflects the method’s sensitivity to short, abrupt deviations in vibration behavior, making it well‑suited for early fault detection. However, the increased responsiveness also means that more benign variations may be labeled as anomalies.


Final Thoughts: The Importance of High-Quality Vibration Data

All the techniques discussed, whether statistical, spectral, or machine learning, depend heavily on one critical factor:

“Data Quality”

Poor-quality data leads to:

    • Misleading frequency content
    • False anomalies
    • Missed fault signatures

High-quality vibration data must have:

    • High sampling rates to capture fast dynamics
    • Low noise levels
    • Accurate calibration
    • Reliable synchronization

High quality sensors play a crucial role. They are designed to capture high-resolution, high-fidelity vibration data, enabling precise analysis across time and frequency domains.

Such high-quality data is essential not only for traditional condition monitoring but also for emerging applications like:

    • Anomaly detection systems
    • Predictive maintenance pipelines
    • Agentic AI systems interacting with physical environments
    • Physical AI and digital twins

In modern engineering workflows, data is the foundation, and better data leads directly to better decisions.

 

Share This

Hamed Dabiri

Hamed earned his PhD in 2022, focusing on ML applications in structural dynamics. He then completed a postdoctoral fellowship at Imperial College London, studying Material Strength and ML. With over 27 published papers, his research spans ML, structural dynamics, and material behavior. In 2024, Hamed became a Senior ML Engineer at Mide Technology, applying his...

By signing up you are agreeing to our Privacy Policy