Questions tagged [benchmark]
For questions about standard test instances for evaluating the performance of Operations Research models or algorithms.
20
questions
1
vote
1
answer
120
views
Benchmark problems for Benders Decomposition
We are implementing a scheduling model using Benders Decomposition. Does someone know of any existing implementation of Benders or any repositories that contain continuous or integer problems solved ...
- 21
1
vote
1
answer
58
views
Set covering SOTA methods and benchmarks
I want to compare different methods for Set Covering problem. So I have 2 questions:
what are the best methods for solving this problem (precise and not precise methods)
what are the most common ...
- 53
2
votes
2
answers
114
views
Runtimes for benchmarking
For a study, I need to make runs to evaluate and compare performance of various models. To evaluate them I need to obtain their running times. I wonder if there is a rule to when to start and end ...
user5245
3
votes
1
answer
163
views
Optimization model testing tooling: likes, dislikes, and wishes
We’re [1] in the thick of building out a testing suite for decision models, starting with a focus on route optimization. There are several angles we care about [2] and are considering: unit testing, ...
- 39
2
votes
1
answer
145
views
How to generate hard instances for number partitioning?
I am trying to compare the performance of some algorithms for multiway number partitioning. I run them on randm instances that I generate with Python's numpy:
...
- 1,015
1
vote
0
answers
72
views
Pick Up Delivery with Time Window example/ Benchmark Problem [closed]
I am trying to solve a pick up and delivery problem with time window (variant of vehicle routing problem). Would anyone be able to direct me to some example problems with known solution or benchmark ...
- 629
7
votes
1
answer
524
views
Bilinear programming vs Mixed integer linear programming performance comparison
I know that both bilinear programming and mixed integer linear programming are NP-hard. But is there a preference to have when choosing an approach to solve a problem that can be represented in both, ...
- 173
4
votes
2
answers
375
views
When solving many MILPs how to assign CPU cores to solver instances?
Let's say I have an 16 core machine and many roughly equally hard MILP problems and enough RAM. The latency of solving doesn't matter. With how many cores should I start solvers on to maximize ...
- 4,037
2
votes
2
answers
475
views
CPLEX output log
Whats the difference between MIP solution and Final Solve? I am trying to benchmark some solution approaches and I am not sure which of those is the more significant... sometimes they have the same ...
- 533
24
votes
2
answers
1k
views
How much can we expect to increase the speed of mixed integer programming in the next 10 years?
Mixed-integer programming is a super powerful tool for operations researchers to solve many difficult problems.
As described by Bixby[1] there has been an overall improvement in the performance of a ...
- 1,659
14
votes
1
answer
4k
views
What are the pros and cons of Hexaly (ex LocalSolver)?
LocalSolver is a company which provides a global optimization solver, combining exact and heuristic techniques.
The benchmarks on their website are quite impressive. For example, they claim they can ...
- 13.6k
5
votes
1
answer
219
views
VRP benchmark instances with charging stations
Are there any benchmark instances for VRP with charging stations? I also have various delivery points with charging stations in the city(Multiple Vehicles). How can I compare my formulation?
- 1,589
7
votes
2
answers
450
views
Are there some benchmark problems for CSP Solvers?
I am building my own CSP solver with simple backtracking, AC3 filtering and variable/value ordering heuristics. It supports non binary constraints. I've done some good progress and I'd like to ...
- 171
9
votes
3
answers
708
views
Vehicle routing benchmark instances
I recently started working on the classical split delivery vehicle routing problem (SDVRP). I appreciate if someone could let me know where to download benchmark instances for this problem? I am also ...
- 2,170
26
votes
6
answers
3k
views
Statistical tests for benchmark comparison
Suppose that you have two algorithms for solving an optimization model, and you want to benchmark their performance over a large set of instances (with only one performance metric, for example, the ...
- 803