Questions tagged [performance]
For Question about Performance of a data science, statistical or machine learning model. Performace is a direct way to measure the efficiency of model. The Performance measure deals with time, accuracy and scalability for improve the model.
182
questions
0
votes
0
answers
24
views
What is appropriate Individual KPI for AI projects?
I work in the sales department of electronics component manufacturing company and we do data science projects using traditional algorithm like Random forests (success likelihood of design project), ...
- 2,585
0
votes
0
answers
22
views
What is the most accurate way of computing the evaluation time of a neural network model?
I am training some neural networks in pytorch to use as an embedded surrogate model. Since I am testing various architectures, I want to compare the accuracy of each one, but I am also interested in ...
- 1
1
vote
1
answer
35
views
How to evaluate the performance of a prediction model across multiple predictions of the same event?
I was thinking of a hypothetical situation where you have a prediction model that can be used to predict the winner of an upcoming football match between Team A and Team B.
Say for the sake of the ...
- 13
0
votes
1
answer
33
views
Why does precision decrease with inceasing threshold?
I've trained a Logistic Regression model using scikit-learns LogisticRegression class. I'm dealing with stock data so it's quite noisy and difficult to predict ...
0
votes
0
answers
14
views
Does it make sense to do hp tuning for a Random Forest for top k precision or recall?
I've trained an RF with a binary classification task that achieves mediocre performance. However, they way it is intended to be used would have end-users look only at predictions with high scores (...
0
votes
0
answers
12
views
Passing the Parallel API tests in PettingZoo for custom multi-agent environment
from pettingzoo.test import (
parallel_api_test,
parallel_seed_test,
max_cycles_test,
performance_benchmark,
)
I have a custom multiagent ...
- 121
0
votes
0
answers
15
views
Comparing a classfiers performance across distinct testing datasets
I have a dataset split into training, validation, and testing sets. I trained this model on the training data and evaluated on the validation and testing sets. Now I have an additional set of data ...
- 73
0
votes
0
answers
12
views
Interpreting large discrepancies between Specificities & the # of Extraneous Variable Models selected by a variable selection algorithm
I am going to preface my question by saying that this problem of interpretation I have run into is in the context of me doing my part as a collaborator on a statistical learning paper for the first ...
- 167
0
votes
0
answers
31
views
Why does the first call to a TensorFlow function execute much slower than the second call?
I was doing an Image Classification problem using TensorFlow. I was generating the mean images for two image datasets having the same size. The dataset was generated using the tf.data API. Thereafter ...
- 87
0
votes
0
answers
32
views
why is there no research on machine learning algorithms to determine optimal hyperparameters for metaheuristics?
I am not shure if I am in the correct forum for this question. I'm sorry, if I'm in the wrong place here.
Question:
Why is there no research on machine learning algorithms to determine hyperparameters ...
- 101
0
votes
0
answers
77
views
How does TensorFlow method tf.data.Dataset.reduce() work?
I was trying to compute the mean of the images that I fetched from a GCS bucket using TensorFlow's tf.data input pipeline. For this, I came across two methods: ...
- 87
0
votes
0
answers
26
views
Different size of deep learning models but similar inference-time
I have three different semantic segmentation models with large differences in size. The first one includes 30,000,000 trainable parameters, the second one about 20,000,000 and the third one about 200,...
- 111
1
vote
1
answer
127
views
Seeking guidance on understanding graphics card parameters for deep learning training
I am currently in the process of purchasing a new Nvidia graphics card for training deep learning models, and I have a few questions regarding the parameters involved and their relationship to the ...
- 11
0
votes
0
answers
104
views
This model is too slow. I'm looking for a good, fast-enough, out-of-the-box, pre-trained image classifier. Any tip?
I have been using this on a laptop without a GPU: https://github.com/pharmapsychotic/clip-interrogator
Currently it takes about 10s to classify a single image on my own computer.
I use ...
- 101
0
votes
1
answer
683
views
How to reduce the false positives to improve the models performance?
I am currently building a binary classification model to predict order return rates. I used the GradientBoostingClassifier for training the model and also performed hyperparameter tuning using ...
