165

I'm currently using Entity Framework for my db access but want to have a look at Dapper. I have classes like this:

public class Course{
   public string Title{get;set;}
   public IList<Location> Locations {get;set;}
   ...
}

public class Location{
   public string Name {get;set;}
   ...
}

So one course can be taught at several locations. Entity Framework does the mapping for me so my Course object is populated with a list of locations. How would I go about this with Dapper, is it even possible or do I have to do it in several query steps?

2

9 Answers 9

217

Alternatively, you can use one query with a lookup:

var lookup = new Dictionary<int, Course>();
conn.Query<Course, Location, Course>(@"
    SELECT c.*, l.*
    FROM Course c
    INNER JOIN Location l ON c.LocationId = l.Id                    
    ", (c, l) => {
        Course course;
        if (!lookup.TryGetValue(c.Id, out course))
            lookup.Add(c.Id, course = c);
        if (course.Locations == null) 
            course.Locations = new List<Location>();
        course.Locations.Add(l); /* Add locations to course */
        return course;
     }).AsQueryable();
var resultList = lookup.Values;

See here https://www.tritac.com/blog/dappernet-by-example/

7
  • 15
    This saved me a ton of time. One modification I needed that others may need is to include the splitOn: argument since I wasn't using the default "Id". Commented Jan 7, 2015 at 16:52
  • 2
    For LEFT JOIN you will get a null item in the location list. Remove them by var items = lookup.Values; items.ForEach(x => x.Locations.RemoveAll(y => y == null)); Commented Jan 23, 2015 at 13:08
  • 1
    I can't compile this unless I have a semicolon at the end of line 1 and remove the comma before the 'AsQueryable()'. I would edit the answer but 62 upvoters before me seemed to think its okay, maybe I'm missing something...
    – bitcoder
    Commented Jul 14, 2016 at 21:31
  • 2
    For LEFT JOIN: Don't need to do another Foreach on it. Just check before adding it: if(l != null) course.Locations.Add(l).
    – jpgrassi
    Commented Jul 13, 2017 at 14:17
  • 2
    Since you are using a dictionary. Would this be faster if you used QueryMultiple and queried course and location separately then used the same dictionary to assign location to course? It'sessentially the same thing minus the inner join which means sql wont transfer as many bytes?
    – MIKE
    Commented May 31, 2018 at 17:10
65

Dapper is not a full blown ORM it does not handle magic generation of queries and such.

For your particular example the following would probably work:

Grab the courses:

var courses = cnn.Query<Course>("select * from Courses where Category = 1 Order by CreationDate");

Grab the relevant mapping:

var mappings = cnn.Query<CourseLocation>(
   "select * from CourseLocations where CourseId in @Ids", 
    new {Ids = courses.Select(c => c.Id).Distinct()});

Grab the relevant locations

var locations = cnn.Query<Location>(
   "select * from Locations where Id in @Ids",
   new {Ids = mappings.Select(m => m.LocationId).Distinct()}
);

Map it all up

Leaving this to the reader, you create a few maps and iterate through your courses populating with the locations.

Caveat the in trick will work if you have less than 2100 lookups (Sql Server), if you have more you probably want to amend the query to select * from CourseLocations where CourseId in (select Id from Courses ... ) if that is the case you may as well yank all the results in one go using QueryMultiple

4
  • 1
    Thanks for the clarification Sam. Like you described above I'm just running a second query fetching the Locations and manually assigning them to the course. I just wanted to make sure I didn't miss something that would allow me to do it with one query.
    – b3n
    Commented Sep 23, 2011 at 4:43
  • 3
    Sam, in a ~large application where collections are regularly exposed on domain objects as in the example, where would you recommend this code be physically located? (Assuming you would want to consume a similarly fully constructed [Course] entity from numerous different places in your code) In the constructor? In a class factory? Somewhere else?
    – tbone
    Commented Aug 27, 2015 at 17:27
  • I was confused about CourseLocations, a table/construct never mentioned in the question. OP lists only 2 entities - is this just assuming there might be an intermediate table?
    – PandaWood
    Commented Sep 27, 2022 at 7:27
  • What if you have 10000s of courses. You are querying the database for mappings 10000s of times. Wouldnt this be more inefficient then getting all the results at once nested via For JSON and deserializing the results to your model?
    – Qiuzman
    Commented Apr 1 at 15:13
49

No need for lookup Dictionary

var coursesWithLocations = 
    conn.Query<Course, Location, Course>(@"
        SELECT c.*, l.*
        FROM Course c
        INNER JOIN Location l ON c.LocationId = l.Id                    
        ", (course, location) => {
            course.Locations = course.Locations ?? new List<Location>();
            course.Locations.Add(location); 
            return course;
        }).AsQueryable();
10
  • 7
    Only problem with this is that you'll be duplicating the header on every Location record. If there are many locations per course, it could be a significant amount of data duplication going across the wire that will increase bandwidth, take longer to parse/map, and use more memory to read all of that. Commented Aug 20, 2018 at 15:03
  • 21
    i'm not sure this is working as i expected. i have 1 parent object with 3 related objects. the query i use gets three rows back. the first columns describing the parent which are duplicated for each row; the split on id would identify each unique child. my results are 3 duplicate parents with 3 children.... should be one parent with 3 children.
    – topwik
    Commented Dec 10, 2018 at 21:22
  • 5
    @topwik is right. it doesn't work as expected for me either. Commented Mar 4, 2019 at 19:30
  • 6
    I actually ended up with 3 parents, 1 child in each with this code. Not sure why my result is different than @topwik, but still, it does not work.
    – th3morg
    Commented Mar 15, 2019 at 16:42
  • 7
    This answer is wrong because returns with one course and 3 locations in the database, would return 3 courses each with one location.
    – Delphi.Boy
    Commented May 8, 2020 at 18:04
41

I know I'm really late to this, but there is another option. You can use QueryMultiple here. Something like this:

var results = cnn.QueryMultiple(@"
    SELECT * 
      FROM Courses 
     WHERE Category = 1 
  ORDER BY CreationDate
          ; 
    SELECT A.*
          ,B.CourseId 
      FROM Locations A 
INNER JOIN CourseLocations B 
        ON A.LocationId = B.LocationId 
INNER JOIN Course C 
        ON B.CourseId = B.CourseId 
       AND C.Category = 1
");

var courses = results.Read<Course>();
var locations = results.Read<Location>(); //(Location will have that extra CourseId on it for the next part)
foreach (var course in courses) {
   course.Locations = locations.Where(a => a.CourseId == course.CourseId).ToList();
}
1
  • 9
    One thing to note. If there are a lot of locations/courses, you should loop through the locations once and put them in a dictionary lookup so you have N log N instead of N^2 speed. Makes a big difference in larger datasets. Commented Dec 15, 2017 at 19:27
10

Sorry to be late to the party (like always). For me, it's easier to use a Dictionary, like Jeroen K did, in terms of performance and readability. Also, to avoid header multiplication across locations, I use Distinct() to remove potential dups:

string query = @"SELECT c.*, l.*
    FROM Course c
    INNER JOIN Location l ON c.LocationId = l.Id";
using (SqlConnection conn = DB.getConnection())
{
    conn.Open();
    var courseDictionary = new Dictionary<Guid, Course>();
    var list = conn.Query<Course, Location, Course>(
        query,
        (course, location) =>
        {
            if (!courseDictionary.TryGetValue(course.Id, out Course courseEntry))
            {
                courseEntry = course;
                courseEntry.Locations = courseEntry.Locations ?? new List<Location>();
                courseDictionary.Add(courseEntry.Id, courseEntry);
            }

            courseEntry.Locations.Add(location);
            return courseEntry;
        },
        splitOn: "Id")
    .Distinct()
    .ToList();

    return list;
}
0
7

Something is missing. If you do not specify each field from Locations in the SQL query, the object Location cannot be filled. Take a look:

var lookup = new Dictionary<int, Course>()
conn.Query<Course, Location, Course>(@"
    SELECT c.*, l.Name, l.otherField, l.secondField
    FROM Course c
    INNER JOIN Location l ON c.LocationId = l.Id                    
    ", (c, l) => {
        Course course;
        if (!lookup.TryGetValue(c.Id, out course)) {
            lookup.Add(c.Id, course = c);
        }
        if (course.Locations == null) 
            course.Locations = new List<Location>();
        course.Locations.Add(a);
        return course;
     },
     ).AsQueryable();
var resultList = lookup.Values;

Using l.* in the query, I had the list of locations but without data.

1

Not sure if anybody needs it, but I have dynamic version of it without Model for quick & flexible coding.

var lookup = new Dictionary<int, dynamic>();
conn.Query<dynamic, dynamic, dynamic>(@"
    SELECT A.*, B.*
    FROM Client A
    INNER JOIN Instance B ON A.ClientID = B.ClientID                
    ", (A, B) => {
        // If dict has no key, allocate new obj
        // with another level of array
        if (!lookup.ContainsKey(A.ClientID)) {
            lookup[A.ClientID] = new {
                ClientID = A.ClientID,
                ClientName = A.Name,                                        
                Instances = new List<dynamic>()
            };
        }

        // Add each instance                                
        lookup[A.ClientID].Instances.Add(new {
            InstanceName = B.Name,
            BaseURL = B.BaseURL,
            WebAppPath = B.WebAppPath
        });

        return lookup[A.ClientID];
    }, splitOn: "ClientID,InstanceID").AsQueryable();

var resultList = lookup.Values;
return resultList;
0

There is another approach using the JSON result. Even though the accepted answer and others are well explained, I just thought about an another approach to get the result.

Create a stored procedure or a select qry to return the result in json format. then Deserialize the the result object to required class format. please go through the sample code.

using (var db = connection.OpenConnection())
{                
  var results = await db.QueryAsync("your_sp_name",..);
  var result = results.FirstOrDefault();    
                    
  string Json = result?.your_result_json_row;
                   
  if (!string.IsNullOrEmpty(Json))
  {
     List<Course> Courses= JsonConvert.DeserializeObject<List<Course>>(Json);
  }
    
  //map to your custom class and dto then return the result        
}

This is an another thought process. Please review the same.

2
  • What about the performance of such approach, compared to multi-mapping and/or using a dictionary for lookup? Let's say I need to fetch a 1000 records from DB, each containing 8 properties and two sub-lists of 2 objects with 3 properties each. Isn't it true that using FOR JSON PATH is rather costly on the DB server (depending ofcourse on the object structure it needs to construct)? Commented Oct 19, 2022 at 19:54
  • @RollerMobster did you ever figure out if it is more costly?
    – Qiuzman
    Commented Apr 1 at 15:16
0

Use GroupBy if you want to avoid dictionary. Something like

var result = await con.QueryAsync<Course, Location, Course>(joinQuery, (course, location) => 
      {
          course.Locations = [location];
          return course;
      }, splitOn: "LocationId")
      .GroupBy(course => course.Id)
      .Select(group => 
      {
          var course = group.First();
          course.Locations = group.SelectMany(course => course.Locations).ToList();
          return Course;
      }
      .ToList();

Not the answer you're looking for? Browse other questions tagged or ask your own question.