Questions tagged [accuracy]
In data science, accuracy is a measurement used to determine which model is best at describing the underlying patterns of a dataset.
405
questions
0
votes
1
answer
12
views
How to aggregate classes for higher overall accuracy?
I have trained a classifier on a dataset that comprises a large number of classes. Some classes are easy to predict, whereas others are frequently misclassified.
I would like to aggregate the classes ...
- 681
0
votes
0
answers
9
views
Validation accuracy dip and recovery when restarting training
i was fine-tuning this large language model with Stochastic Gradient Descent and mid epoch i stopped training, and saved the model weights. Then at a later time, reloaded the weights and restarted the ...
- 101
0
votes
1
answer
18
views
How are the mini-batches performance used to obtain the overall accuracy in ML packages?
For the sake of exemplification, let us consider the the time series convolutional neural network (CNN) classifier from the sktime (this question can be applied for ...
- 123
0
votes
0
answers
18
views
Loss increase while accuracy also increase [duplicate]
I'm training a fairly large classification model,and I'm having the below results.
...
- 13
0
votes
0
answers
13
views
0
votes
0
answers
18
views
How to interpretmulti-class confusion matrix?
I'm looking at the SAMHSA Mental Health Client-Level dataset. I did some t-SNE plots (dropping irrelevant cols, normalizing some, one-hot encoding some) of 500k rows out of 6.5mil.
I'm trying to do ...
- 111
0
votes
0
answers
37
views
Why is there a difference in Training Accuracy Output, when the training dataset is the same but the validation dataset is different?
I am looking at the output of a multi-class image segmentation deep learning model. I used U-Net to implement this.
I am confused about why the training accuracies are different for a different ...
0
votes
0
answers
21
views
Random Forest Classifier Removing Features using Top-N Features Method
I am a new-comer to data science and machine learning techniques and processes. I'm working on a personal project that predicts the winner of an NBA game using a random forest classifier. I have ...
0
votes
2
answers
34
views
how to fix my increasing validation loss and decreasing training loss?
here is the code that got me this, please i need an advise on what to do to correct this.
...
0
votes
0
answers
25
views
The accuracy of my model (AutoEcoder) Stops always at 50%, I want 95%
Hello StackOverflow community,
I'm working with a dataset comprising binary vectors. For each instance in my dataset, there is an input vector X and an output ...
- 101
0
votes
0
answers
57
views
Is this the appropriate way to calculate a multiclass reliability diagram for model calibration?
I'm trying to generalize reliability diagrams [1] to a multiclass classifier and implement that using pytorch and pytorch-metrics.
So far so good but I'm somewhat confused about the definition of ...
- 101
0
votes
1
answer
51
views
Why is my genetic algorithm overfitting so much?
I'm only training on a fraction of the data each generation:
...
- 111
1
vote
1
answer
38
views
How to deal with categorical disalignment in test and train in binary classification problems
I have a train and test datasets (600k observations) that have different categories for the same categorical variable.
For example train has the categorical variable Letters having unique categories ...
- 13
0
votes
0
answers
47
views
Finding Accuracy, Recall, Precision, and F1 from Matlab Confusion Matrix
I'm working on a project to find the highest accuracy between KNN and a Decision Tree for Classification using Matlab.
How to calculate the Accuracy, Recall, Precision, and F1 from the output below? ...
- 1
2
votes
1
answer
132
views
Why the test accuracy showing some odd behaviour in comparison to train accuracy?
I am currently training an ANN using Sequential(a class from Keras API within tensorflow), and I am optimizing the model's architecture and came across something I have not seen before.
The graph of ...
- 23