Questions tagged [preprocessing]
Preprocessing is a relative term that usually refers to simpler operations applied to improve the operation of a more complex algorithm.
55
questions
0
votes
0
answers
41
views
Fiber Photometry (Fluorescence) Signal Preprocessing through Source Separation and Baseline Correction
I am working on preprocessing fiber photometry data. The data collection involves inserting fibers into an animal, where the reflection of specific wavelengths of light is captured. We collect two ...
0
votes
0
answers
8
views
What is the best approach when training and HDR model with LDR data?
I am working on this project "EMLight".
Data: HDR Panoramic Photos
y: Illumination Map of the Panorama
X: HDR Croppings from the Panorama
I want to make this project work with LDR photos, ...
- 1
1
vote
1
answer
181
views
CWT: selection of scales and filtering
I am using CWT to obtain scalograms of ECG signals as the one below:
In my research, most articles contain a pre-processing step before performing CWT (that usually includes signal normalization and ...
- 11
1
vote
1
answer
387
views
Check whether signal is periodic
I have a signal with multiple frequencies. The frequency changes depending on the amount of air flowing through the fuel snap. The signal resembles a square wave ranging from $0.4$ to $4.5$ Volts and ...
- 13
1
vote
1
answer
409
views
Creating Triangle Filters for Smoothing using Python
The 'binning' process consists in summing the energies (squared magnitude) within groups of adjacent FFT values. This will give you the total energy in a set of disjoint frequency bands.
A more ...
- 77
2
votes
0
answers
32
views
Auditory models which are not human
I am doing a machine learning project and I'm interested in the different pre-processing techniques which can be applied to audio data. In particular, I am interested in comparing a human auditory ...
- 121
1
vote
1
answer
90
views
magnitude spectrum
I have an ECQ signal of 360 Hz sampling frequency. I used an FFT to extract the frequency spectrum of my signal. Now I don't know exactly how to interpret this plot. How can I know the noise from ...
- 31
3
votes
1
answer
81
views
Verification of intermediate outputs in Signal processing chain of FPGA
I have two ADC interfaces with FPGA and 32-bit processed output data from FPGA.
I have an IO signals to verify the Inputs and Outputs of FPGA.
But I dont have any test points to verify the ...
- 31
0
votes
0
answers
75
views
Peak Sharping of multi-signal data
I have multi-signal data and as a processing step want to apply peak sharping of signal as shown in fig below.
is there any way I can achieve this in python ?
Literature :Paper 1(Peak sharping section ...
- 101
0
votes
2
answers
52
views
Digital Signal Quantized Processor Complexity
In “traditional” digital signal processing, the complexity is computed as a number of multiplication the operation requires, e.g. the computation of the N-point DFT via the decimation-in-frequency FFT ...
- 1
1
vote
1
answer
46
views
How to validate that an audio algorithm result is independent of microphone device?
I have a machine learning algorithm that takes speech sample audio recordings collected from mechanical Turk. During processing it was shown that some audio from certain OS/microphone devices have ...
- 133
0
votes
0
answers
1k
views
Pre-Processing Wi-Fi Channel State Information (CSI) Data
I was successfully able to collect some CSI data using the existing tool(s) on GitHub (https://github.com/StevenMHernandez/ESP32-CSI-Tool). The CSI data is a pair of imaginary and real number which ...
- 1
1
vote
2
answers
764
views
My 3x3 Weighted Median Filter doesn't seem to be improving my image quality
In order to reduce noise in my training dataset,I attempted a WMF whose weights are shown in a 2-D array as follows(values finally get normalized by division by 15:
...
1
vote
0
answers
176
views
How to detect offset that changes along time in a signal?
I have an issue that has to do with detrending a signal. First, it seems my signals behaves a little unusual (for me, I think). Some signals starts with a quite large offset, then it seems to ...
3
votes
1
answer
1k
views
Baseline correction for continuous EEG signals
I'm new to the topic so forgive the trivial question.
I am trying to understand data preprocessing for EEG signals. As I understand, after recording continuous EEG signals, they should be band-pass ...
- 131
0
votes
1
answer
186
views
What's the purpose of augmenting an image with a random "gradient"?
I have the following Python code
...
user40095
0
votes
0
answers
165
views
FFT response for noisy signal, averaging the response and
I try to analyze a system's state with acceleration sensors by measuring the frequencies and amplitudes.
Since a cheap sensor is used, I have a noisy signal in the beginning (up to 40Hz - see below). ...
- 1
1
vote
0
answers
89
views
Measuring respiratory rate from a 3d accelerometer signal? How do I preprocess this data and move forward with it?
I have read a decent amount of papers that used wrist smartwatches to measure respiratory rate, or papers that used sensors attached to a persons chest. I can link them if it is necessary.
I am ...
- 11
0
votes
0
answers
57
views
Detect Trigger in vibrational data
I'm trying to classify states with a 1D-CNN-Network structure. Therefore I need to analyze the incoming vibrational data in a certain window. Two examples of such signals are shown below.
I'm ...
- 1
0
votes
1
answer
285
views
Help with automated baseline removal
This is more of a conceptual question, so apologies in advance if this is not the correct forum for such questions.
I am trying to find a repeatable and consistent method for removing the baseline of ...
0
votes
1
answer
159
views
How should I remove obvious anomalies from spectral data?
I'm working with raman spectra and it seems that our spectrometer produces some anomalies at very specific wave numbers and I'm looking to remove them from the dataset. Here's a picture of 27 spectra ...
- 33
-1
votes
1
answer
318
views
How to apply baseline methods to MNE preprocessed raw EEG signals?
I am new at EEG preprocessing and classification. I have followed Clemens Brunner's blog https://cbrnr.github.io/2018/01/29/removing-eog-ica/ as a tutorial for MNE.
This is how I have preprocessed ...
0
votes
0
answers
456
views
Upsampling and downsampling signals as a preprocessing step for a neural network
I have audio data acquired from a 4 channels sensors array.
As a preprocessing step for a neural network, I want to beamform and focus on the sound source. For higher resolution in the beamforming ...
- 682
0
votes
1
answer
936
views
How to take inverse fft of windowed and callibrated fft data? [closed]
I have done windowing and fft on a signal but when I try to recover original raw signal ,I am unable to do it .Can anybody help me.
How to take inverse fft of windowed and callibrated fft data?
...
9
votes
8
answers
4k
views
Is sound the best way to transmit a signal under water?
Could sound be used in transmitting sound waves under water digitally? Could the sound then be converted by a repeater to transit by radio waves? What other ways can a signal be transmitted other than ...
- 1
1
vote
1
answer
2k
views
Frequency analysis to determine low-pass cut off frequency
I collected some data for a practical application, where the signal represents force data obtained from an impact of a punch against a force plate attached to a quasi-rigid rig (it moves once the ...
0
votes
1
answer
2k
views
Subtracting DC Offset a Complex Signal?
If I take the magnitude of a complex signal, and then subtract the mean amplitude, I remove DC offset but lose the real and imaginary components. How can I properly subtract the DC offset of a complex ...
- 11
1
vote
2
answers
192
views
How do I know if my EEG signal need denoising?
I recently started working on sleep study.
For my research I download sleep EEG data from physionet. The EEG data has 100 Hz sampling rate and was recorded from 2 bipolar EEG site.
When I start the ...
- 143
1
vote
0
answers
163
views
Calculating gyroscope data from accelerometer and attitude data
I am currently collecting accelerometer and attitude data using smartphone sensors. Data is collected at 100Hz over 2.5 seconds. Of which there are 250 accelerometer points and 250 points representing ...
- 11
0
votes
1
answer
46
views
Does waveform-based ASR with lowpass filtering preprocessing still require the assumption of FFT?
I read some recent papers about time-domain speech recognition, and wondering if it steers away from the stationary assumption of FFT. However, some preprocessing operations like pre-emphasis and low-...
- 1