Skip to main content

All Questions

1 vote
2 answers
81 views

Comparability between Pearson's Correlation and more complex machine learning models

If relationships between two or more variables are found by Support Vector Machines, Random Forests, Decision Trees, and/or Extreme Learning Machines, could a simple Pearson's Correlation also detect ...
bash-asker's user avatar
1 vote
1 answer
233 views

What does it mean to have negative correlation coefficient for independent variables?

I am working with a dataset with high dimensionality (107 columns vs. 800 rows). All columns are binary in nature indicating the presence of a specific column value or not in the dataset. I used ...
pandi20's user avatar
  • 71
1 vote
1 answer
105 views

Can I multiply the Pearson Coefficients by 10 to make impact?

I have extracted the Pearson correlation Coefficients between the labels and features. Can I multiply the final correlation score for each score by 10 to make it higher to investigate it with machine ...
Krebto's user avatar
  • 101
1 vote
0 answers
19 views

Single metric that evaluates how much the data is correlative [closed]

I want to calculate a single metric that evaluates how much the data is correlative. For example, I thought about averaging the absolute values of the correlation matrix. Is there a known metric for ...
Amit S's user avatar
  • 57
0 votes
0 answers
38 views

how to find significant predictors that is effecting correlation

I have a dataset with dimensions 10x53 where 53 patients(p1 to p53) as column variables and 10 rows of activity count measured for 10 days (d1 to d10). all the data is numerical. sample dataset is as ...
Ram's user avatar
  • 1
0 votes
0 answers
28 views

Pearson correlation for comparing models [duplicate]

I want to know if I can use Pearson correlation coefficient (i.e. whether my PS satisfies its usage or I need to look at other correlation measures) to study the extent of correlation between 2 ...
Maaz's user avatar
  • 317
0 votes
0 answers
33 views

How is this simplified pearson coefficient derived? [duplicate]

I came across a variation of the Pearson coefficient as seen here: $$r=\left[1-\left(\frac{\sum_{i=1}^n (x_{ti}-x_{pi})^2}{\sum_{i=1}^n x^2_{ti}}\right)\right]^{1/2}\,,$$ where $x_{ti}$ is a target ...
Nishalc's user avatar
1 vote
1 answer
648 views

Higher Spearman but lower Pearson correlation?

I recently engineered a replacement for one of the most important features in my production model. This replacement makes more intuitive sense than the current version of the feature, and I was ...
dotfit's user avatar
  • 11
14 votes
1 answer
7k views

MSE as a proxy to Pearson's Correlation in Regression Problems

TL;DR (too long, didn't read): I'm working on a time-series prediction problem, which I formulate as a Regression problem using Deep Learning (keras). I want to optimize for the Pearson correlation ...
galoosh33's user avatar
  • 2,302