15:01:54 #startmeeting 2016-03-16 - Evergreen focus group discussion on search 15:01:54 Meeting started Wed Mar 16 15:01:54 2016 US/Eastern. The chair is kmlussier. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:01:54 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:01:54 The meeting name has been set to '2016_03_16___evergreen_focus_group_discussion_on_search' 15:02:17 #topic Introductions 15:02:30 Please introduce yourselves, as follows 15:02:36 #info kmlussier is Kathy Lussier, MassLNC 15:02:49 #info miker == Mike Rylander, Equinox (in and out) 15:02:57 #info afterl is Amy Terlaga, Bibliomation 15:03:49 #info sarahchilds is Sarah Childs (surprise), Hussey-Mayfield PL, Evergreen Indiana 15:03:49 While we wait for more people to join us, I'll post a link to our page where we have 1) ground rules for the discussion and 2) logs from our previous chats. 15:04:03 #link http://wiki.evergreen-ils.org/doku.php?id=scratchpad:search:focus_groups 15:04:22 #info rhamby is Rogan Hamby, Equinox Software (mostly lurking) 15:04:51 Basically, this chat is an opportunity to talk about ideas for search. Although it's tempting, especially for technical folks, to get in the nitty gritty of how to make those ideas happen, we don't want to get bogged down in the details today. 15:05:07 We really want to focus on end results today. 15:05:21 Also, as is the case with any brainstorming, there are no stupid ideas. Feel free to share whatever ideas you have. And please don't be critical of others ideas. 15:05:29 However, I do encourage you to build upon each other's ideas. 15:06:01 I think we have a smaller turnout today than we have on other days, so I hope you all feel talkative! :) 15:06:46 I'm going to start our first topic, but if anyone comes in late, please feel free to introduce yourselves and join in. 15:07:20 #topic Strengths of current search 15:07:35 I want to start by asking people to identify what they like about the current Evergreen search. 15:07:45 What are its strengths? 15:07:48 @info dbs is Dan Scott, Laurentian University 15:07:48 dbs: (info ) -- Returns information from the given RSS feed, namely the title, URL, description, and last update date, if available. 15:07:52 #info dbs is Dan Scott, Laurentian University 15:09:47 Keyword searches work as a great default for us for the vast majority of searches 15:09:53 Search filters work relatively well 15:10:15 Filters make good use of MARC data 15:10:25 dbs: And when you say they work well, is that because there is good coverage of the record? 15:10:43 kmlussier: seems to hit the most important bases, yep 15:10:48 OK, good. 15:11:15 And we like the advanced search filters and the fact they make use of the MARC data. 15:11:19 The reason I ask this question is because, if we make major changes to search, we want to make sure we don't lose the things that are already working well for us. 15:11:32 So think of the question in terms of things you don't want to lose. 15:11:37 extensibility of search/filter configuration ... though "yay, lots of knobs!" / "boo, lots of knobs :(" 15:12:24 So there are pros and cons to the amount of configuration we have in search. 15:12:52 Is there anything Evergreen search has that you think makes it unique? 15:13:45 * miker wonders if he should cheat and pull from yesterday's log :) 15:13:52 It seems pretty rare to use fixed fields so extensively for filtering 15:14:24 miker: No cheating allowed. 15:15:12 Sorry, I purposely allow for quiet moments because it makes people think harder. 15:15:26 :) 15:15:36 But I'll move on to the next topic. If you think of anything else while we're talking, feel free to shout it out. 15:15:38 kmlussier: so looks like we'll be reading yesterday's log on our own .... homework 15:15:46 heh 15:16:02 afterl: I'll be compiling the results at some point if you want the Cliff Notes version. 15:16:19 #topic Areas for improvement 15:16:22 kmlussier: yes, thanks. Cliff Notes work 15:16:29 Where are the areas where you would like to see improvement? 15:17:43 I'd like to see search provide suggestions based on authority records 15:18:01 #info Bmagic = Blake GH, MOBIUS 15:18:06 sarahchilds: OK, can you expand upon that? Is this in keyword searching? 15:18:19 Hi Bmagic! Welcome! 15:18:58 I'd like a true relevance/popularity blended search. And yes, that may force kmlussier to explain what's coming down the road, but maybe that's not allowed here (not the time and place)? 15:19:10 Maybe. If you do a search for doctors, you could get a Did you mean: Physicians 15:19:39 sarahchilds: Ah, I see. So it's a "Did you mean?" but leveraging authority data. Gotcha. 15:19:59 If you do a search for Samuel Clemens, it would suggest Mark Twain 15:20:15 I'd like to see grouping of search results based on external links to, say, OCLC Work Entities 15:20:32 To follow up on what afterl said, we do have activity metrics coming to search that afterl and I have been testing. But the blending of popularity with relevance is tricky. And we're still working on it / testing it. 15:21:42 dbs: Can you give me an example of a search that would use that and how the info would be presented to the user? 15:24:18 kmlussier: sure. A regular search for "Huckleberry Finn" would give you all of the hits for "Adventures of Huckleberry Finn" based on keywords 15:24:55 but using links to OCLC Work Entities, you could group those records even if they were in different languages and the words appeared nowhere in the record 15:25:10 Ah, nice! Thanks for the explanation dbs! 15:26:14 Are there features you've seen in other search systems that you would like to see implemented in Evergreen? Things that haven't been mentioned yet. 15:28:04 I wish we could offer a single search across not just books but blended with articles, items in our institutional repository, etc, but that's probably out of scope for Evergreen 15:29:09 dbs: Well, for the purposes of this discussion, I don't think we should say anything is out of scope for the project, because if it's turns out to be something a lot of Evergreen users want to see, then maybe it becomes part of the scope at some point. 15:29:34 dbs: But I also think a search like that needs to be handled well so that the user doesn't get lost in results. 15:30:12 dbs: that could be part of a project making Evergreen easier to connect to a discovery system, which would probably touch on search. :) 15:30:33 Are there other parts of search that just drive your users crazy? Or would you say that, overall, they are fairly happy with the existing search? 15:30:45 JBoyer: That's a good point. 15:30:50 Hi terran! 15:31:17 So sorry I'm late, it's my first day back in the office and I'm pulling my hair out! 15:31:45 terran: We're just talking about ways we would like to improve search. Do you have any improvements you would like to see? 15:32:11 This was talked about awhile back (we were going to do development but it never panned out), and Evergreen doesn't do this now, I don't think, and I will be embarrassed if it can now, but having the search terms highlighted in the results (on the display record) would be nice. 15:32:14 The main complaint we get is search speed. 15:32:33 overall my experience with users is that they are pretty happy with existing search and keyword search with the one major qualifier to that being that they want records to float the top based on activity (which is in progress) 15:32:50 with that said, many of these other ideas that have come out of these I'm sure would be welcome as well 15:32:52 terran: Thanks terran! 15:32:54 Users hate when they do a search for a particular title and the item they are looking for shows up low in the results 15:33:46 Most of our users would also like the most popular records to float nearer the top on keyword or title searches. 15:33:55 sarahchilds: So improvements in relevance. Do you find there are specific problems in relevance that cause those records to appear low in the list? 15:34:54 And of course, a good "did you mean...?" service to accommodate mis-spellings and related topics 15:35:06 One of the issues I get complaints about is that our users expect to be weighed more heavily 15:35:19 terran / rhamby: On the popularity front, afterl had brought this up earlier, but there is an ongoing project as rhamby noted, but, from early testing, we're also looking at ways to better blend bib relevance with popularity. Which is tricky. 15:35:30 expect *title* to be weighed more heavily 15:35:49 sarahchilds: Thanks! Then field-weighting is important. 15:36:13 Yes, I strongly agree with weighing title (and primary author) more heavily 15:36:29 I know there is some ability to configure field-weighting in Evergreen, but I think implementation might not be consistent across the board. As my follow up on these chats, I hope to identify where more documentation may be needed too. 15:36:46 it is and relevance is going to take on different aspects to different audiences. a public library that heavily circulates new best sellers is going to be well served by new active titles floating the top. An academic library I would see as very different in how they want to determine relevance. 15:37:29 rhamby: agreed 15:38:51 Things I'm seeing in areas for improvement, then, are "Did you Mean?", leveraging authority data in keyword searches, blending popularity with relevance, grouping of search results based on external links, improved speed, and improved relevance. 15:39:14 Did I miss anything? 15:40:07 If not, I'm going to move on to the next topic, which is something we were just discussion. 15:40:15 #topic Defining relevance 15:40:45 I often hear that people want to improve relevance, but, as rhamby just mentioned, what is relevant for one person may not be for another. 15:40:55 15:41:03 So I think it's important that we define what we mean by relevance. 15:41:29 terran: That's a good point. So I wonder if there is a suggested improvement in there for making it easier / more understandable to turn the knobs? 15:41:52 I would support that improvement 15:42:20 What are the factors that you think are important for the system to consider when calculating relevance? 15:42:30 A few have already been mentioned: field weighting, popularity. 15:42:31 field weighting: documentation on what the options mean along with a working example or two with detailed explanation would be most helpful 15:42:33 Are there other factors? 15:43:23 Or other specific areas where you see relevance falling short? 15:43:23 relevance: I think it might be useful to look at titles with the most copies being considered more relevant 15:43:44 terran: yes! 15:44:16 terran: Ok, is that because you see that as one way libraries define that one record may be more important than others? 15:45:00 lots of copies would be one metric of popularity 15:45:19 yes - at least for large public libraries and fiction, the more popular an item is, the more copies there will likely be 15:46:06 Thanks! 15:46:10 Titles with a large number of holds would also indicate popularity 15:46:16 Any other factors you think are important for relevance. 15:46:50 Also in a consortium, even if everyone has only one copy, if most libraries own it, that indicates popularity as well 15:46:57 I just caught up with the convo, forgive me, a call came in during this meeting. I have had problems getting the search results I want. Relevance is one reason, and title searches being so limiting is another reason 15:47:05 sarachilds: true! 15:47:10 To give a little background on the activity metric, titles with a large number of holds and circs are all types of activity that scores a badge for a record. But I don't want to go to deep into the details here. 15:47:34 It doesn't cover total # of copies, but you typically find that you get higher circs on those records with more copies. 15:47:36 When I get 0 search results, I would like it to instead go ahead and do another similar search that will return something 15:47:38 kmlussier: yes, I'm really interested in that project that you're working on 15:47:57 Bmagic: Can you tell expand upon what you mean when you say title searches are limiting? 15:48:24 Bmagic: Also, I would be interested in hearing where you would like to see improvements in relevance. 15:49:17 The title index isn't the same as keyword by design, but (also by design) it's not encompassing what some of us consider to be the title. I don't know, basically, it needs to "learn" from popular searches 15:49:18 Bmagic: I wouldn't want it to *do* the search, but I'd want it to suggest a meaningful alternative 15:49:39 Bmagic: I like that idea, or to at least suggest options for other searches when there are 0 results. 15:50:08 Bmagic: Ah, that's interesting. So you're looking for something that can learn from user behavior? 15:50:28 I realize this would require a ton of work for little visual improvement, but I'll mention it just so it's known: a re-architecting that removes the need for a core limit of records returned would be helpful. (i.e. we have a lib that can't be searched for a common keyword unless the core_limit is close to 80K...) 15:51:15 "A ton of work" may be an understatement, also. :) 15:51:21 I think that might be a possible solution. Search phrasing is remembered, and called back on future searches to help the next individual 15:51:29 JBoyer: Yes!!! Not returning any results when there are results to be returned is so not cool 15:51:37 JBoyer: Thanks for that! But I don't want the "ton of work" ideas to go unmentioned, because maybe a ton of work is ultimately needed. Or maybe not. 15:52:06 JBoyer: I agree. 15:52:29 OK, we're reaching the eight-minute mark, so I want to move on to my final question. 15:52:43 #topic Top-priority improvements 15:53:01 If you could only make two improvements to Evergreen search, what would they be? 15:53:10 It's been said before, but SPEED 15:53:13 Basically, what do you consider to be the most important issues? 15:53:13 1) Speed 15:53:28 2) did you mean? 15:53:36 Hard to argue with speed 15:53:57 This is why we have 2 instead of 1. The 1st time around it was all speed. 15:54:12 Speed, 0 or few results automatically expanded to popular related searches 15:54:13 JBoyer++ # Suggesting that we let people pick two. 15:54:23 And I really want to see that popularity/relevance blended search results 15:55:42 sarahchilds: Do you have a #2? 15:55:44 Going back to earlier suggestions (since I was late) - I would also like a facet on the search results for audience type (is this possible in the current system already? I haven't delved into how facets work yet) 15:55:59 It's too hard to choose! I love them all :-) 15:56:02 terran: If it is possible, I don't know how to do it. 15:56:34 terran: Thank you for adding that suggestion! 15:56:55 Ooh, also a facet for fiction vs nonfiction 15:57:15 Ok, I might wrap up a little early. But is there anything else you had hoped we would cover today that we didn't? 15:57:29 terran: Yes, we also had one from a previous group on publicate date ranges. 15:57:35 publication, even 15:58:34 One for language might be helpful for a lot of libraries, too 15:58:45 OK, I'm going to wrap up the meeting, then, but let me know if anything comes to mind later on. 15:58:51 Thanks everyone for sharing your ideas today! 15:58:55 #endmeeting