1. Evergreen 3.8.4

This release contains bug fixes improving on Evergreen 3.8.3. This release includes fixes for three security bugs.

1.1. Security Fixes

1.2. Fix SQL Injection Vulnerability

An SQL injection vulnerability related to the implementation of search term highlights is now closed.

This is Bug 2004055.

1.3. Malicious Search Protection

Evergreen sometimes sees some "novel" query strings in the wild that cause the search backend to time out or worse. These are sometimes malicious and sometimes accidental, but the effect on users is the same.

The changes here improve query compilation in several respects in order to reduce the chances of an overly complex query causing problems for the search subsystem.

More work is done up front to simplify and combine parts of the resulting SQL, allowing more work to be done closer to the data. This change allows Evergreen to handle many more tested or chained boolean expressions, and negated terms are now handled directly in line with other adjacent terms. Phrases (exact matches) are now searched for using Postgres' adjacency tsearch operator.

All of these changes work together to improve performance by getting more search work done in fewer database operations while protecting against certain query constructs that have caused problems in the past.

This is Bug 1775958.

1.4. Restrict login redirect

As a security best-practice, Evergreen should not allow arbitrary redirection on successful login, but instead limit redirection to local links or configured domains and schemes.

This feature is controlled by a new global flag called opac.login_redirect_domains which must contain a comma-separated list of domains. All hostnames under each domain is allowed for redirect, and the scheme of the redirect URL must be one of http, https, ftp, or ftps.

This is Bug 1908576.

1.5. Acknowledgements

We would like to thank the following individuals who contributed code, testing, and documentation to the 3.8.4 point release of Evergreen:

  • Jason Boyer

  • Galen Charlton

  • Mike Rylander

2. Evergreen 3.8.3

This release contains bug fixes improving on Evergreen 3.8.2. This release includes fixes for two security bugs.

2.1. Security Fixes

2.1.1. Protect qtype CGI Parameter

Malicious DoS attempts have been witnessed in the wild making use of the fact that Evergreen does not check the contents of the qtype CGI parameter. While these fail their intent, it would be better to simply drop such searches on the floor when they’re seen.

Evergreen will now confirm that the search class in the qtype parameter is valid, and that the remainder of the value is structured correctly, before processing the search request.

This is Bug 1811685.

2.1.2. Catalog Search Denial of Service Protection

Here we add two ways to protect against denial of service attacks:

  • Limit concurrent search requests per client IP address

    • This helps address issues of accidental spamming from a malfunctioning OPAC workstation, or web crawlers of various types. The limit is controlled by a global flag called opac.max_concurrent_search.ip. By default there is no limit set.

  • Limit the global concurrent search requests for the same query

    • This helps address both simple and distributed DoS that send the same search request over and over. The limit is controlled by a global flag called opac.max_concurrent_search.query, and defaults to 20.

When a limit is exceeded the client receives an HTTP 429 "Too many requests" response from the web server, and the connection is ended.

This is Bug 1361782.

2.2. Upgrade notes

  • Bug 2003707 - During upgrade, if you’re running with opensrf_core.xml located anywhere other than /openils/conf in a single-tenant manner, make sure that SYSCONFDIR as set in autogen.sh matches what’s set in the installed Cronscript.pm

  • Bug 1361782 includes a schema upgrade

2.3. Bug Fixes

2.3.1. Administration

  • autogen.sh can now accept a -c switch to specify the location of opensrf_core.xml. This is useful for certain multi-tenant setups of Evergreen. (Bug 2003707)

  • Avoids permission lookup when there’s no authtoken (Bug 1990306)

2.3.2. Documentation

  • Updates to Standing Penalties and Group Penalty Thresholds documentation

2.4. Acknowledgements

We would like to thank the following individuals who contributed code, testing, and documentation to the 3.8.3 point release of Evergreen:

  • Jason Boyer

  • Galen Charlton

  • Jeff Davis

  • Andrea Buntz Neiman

  • Jane Sandberg

  • Chris Sharp

  • Josh Stompro

3. Evergreen 3.8.2

This release contains bug fixes improving on Evergreen 3.8.1.

3.1. Upgrade notes

  • Bug 18980409 introduces a new library setting - "Require call number labels in Copy Editor"

  • Bug 1771636 introduces a workstation setting to show full library name in addition to library shortname

3.2. Bug Fixes

3.2.1. Administration

  • Fixes a memory leak when performing fleshed Fieldmapper search (Bug 1974195)

  • No Holdings View Loaded For the Pre-cat Bib (Bug 1976557)

  • Permission Groups editor now indicates when a permission overrides a parent permission (Bug 1891375)

  • Adds sorting and filtering to the Circ Limit Sets interface (Bug 1945385)

  • Blocks deletion of Shelving Locations that have items attached (Bug 1910546)

3.2.2. Catalog

  • Adds independent Org Unit Admin Scrolling for separate navigation of org unit tree and configuration form (Bug 1884950)

3.2.3. Cataloging

  • Reduce parallel requests initiated by AngularJS holdings editor (Bug 1930617)

  • Angular editor is now used when accessed from item status and item buckets (Bug 1956619)

  • Holdings editor now enforcing required stat cats (Bug 1965448)

  • Fixes an issue where creating new copy alerts / notes and item tags failed for brand new copies (Bug 1959716)

  • Fixes several bugs that prevent item notes from being correctly deleted by the Angular item attributes editor (Bug 1955065)

  • Fixes a regression that required a call number label in order to save an item. A new library setting determines whether call number labels are required or not. (Bug 18980409)

  • Fixes issues preventing creation of item alerts / notes and management of existing copies in the copy editor (Bug 1959716)

  • Fixes several bugs that prevented item tags from being correctly deleted by the Angular item attributes editor (Bug 1981095)

  • Fixes an issue where item alerts contained within copy templates failed to apply when using the new Angular holdings editor. (Bug 1956790)

  • Improves the saving of holdings templates in the Angular holdings editor. (Bug 1957179)

  • Fixes an issue where shelving locations for ancestor org units weren’t included in the shelving location drop down menu in the holdings editor. (Bug 1976002)

  • Adds the full organizational unit path to the Copy Location Selector (Bug 1955627)

  • Fixes an issue where item alert types did not display in the Angular item attributes editor (Bug 1978889)

  • Fixes an issue where creating item alerts would fail in the Angular item attributes editor (Bug 1956986)

3.2.4. Circulation

  • Fixes an issue where item alerts prevented hold capture when Hold Capture Delay Verification was used (Bug 1735221)

  • Performance fix to add request serialization to Edit Due Date in Items Out tab (Bug 1932203)

  • Fixes Holds Pull List to show Library Shortnames instead of Library IDs in Requesting Library and Selecting Library columns (Bug 1978839)

  • On the Holds Shelf the “User Display Name” and “User Alias or Display Name” fields will now use the preferred name if present. (Bug 1838553)

  • Adds manual refresh for patron penalties (Bug 1823225)

  • Adds a missing patron-visibility flag to messages created for the patron message center by notification action triggers (Bug 1958573)

  • Fixes a typo on the Holds Details screen of View Holds (Bug 1979099)

  • Fixes issues with printing from Angular. The option to print landscape is restored and the size of the text is no longer scaled down. This affected printing of the Holds Pull List. (Bug 1986725)

  • Changes the patron print bills page label from select "items" to select "copies" (Bug 1980692)

3.2.5. Client

  • Fixes an issue where Angular comboboxes would attempt to fetch all rows from a linked table (Bug 1851884)

  • Adds a workstation setting to show full library name in addition to library shortname (Bug 1771636)

  • Fixes an issue where the shelving location selector didn’t work in several interfaces including adding course materials, circulation limit sets, and distribution formulas in acquisitions. (Bug 1980887)

3.2.6. Course Materials

  • Adds a user visible warning when deleting a Term linked to Courses (Bug 1942647)

  • Fixes an issue where the carriage return activated the Add Materials and Add User buttons (Bug 1930896)

  • Fixes a display issue where the updated call number is not reflected in the grid when adding materials to courses. (Bug 1907974)

  • Fixes issues with the Course Details page display of an archived course. (Bug 1939994)

3.2.7. Documentation

  • Updates to the Holds Management page documentation

  • Updates to Authorities documentation

  • Adds Group Penalty Threshold documentation

  • Updates to Carousels documentation (Bug 1901895)

  • Updates to My Accounts section to reflect changes in Bootstrap

3.2.8. OPAC

  • Fixes formatting in Current Holds Group table in MyAccount (Bootstrap OPAC) (Bug 1950345)

  • Fixes formatting in Holds Groups Table in MyAccount (TPAC) (Bug 1950514)

  • If DOB is marked required, blocks self-registration form from submitting with a blank DOB (Bug 1950166)

  • Fixes an issue where DOB field would auto populate with the current date (Bug 1951642)

  • Fixes an issue where payments made in the OPAC via Stripe were not credited in Evergreen for circulation bills as well as making minor display tweaks to Bootstrap. (Bug 1981628)

  • Adds a missing patron-visibility flag to messages created for the patron message center by notification action triggers (Bug 1958573)

  • Fixes an issue in Bootstrap where the headers in advanced search couldn’t be translated. (Bug 1991395)

  • Fixes an issue in Bootstrap where list titles and descriptions couldn’t be edited. (Bug 1909583)

  • Other Formats and Editions now displays more prominently in Bootstrap. (Bug 1903767)

  • Restores the ability to update existing holds if a patron changes certain notification preferences or contact information. Evergreen will detect these changes and ask ther patron if they want to update existing holds with the new contact information and/or notification preferences. (Bug 1902272)

  • Adds the add basket to bucket functionality in Bootstrap OPAC (Bug 1898775)

  • Fixes an issue with SSO Shibboleth logout and re-login. (Bug 1989209)

3.3. Acknowledgements

We would like to thank the following individuals who contributed code, testing, and documentation to the 3.8.2 point release of Evergreen:

  • John Amundson

  • Jason Boyer

  • Dan Briem

  • Eva Cerninakova

  • Galen Charlton

  • Garry Collum

  • Dawn Dale

  • Jeff Davis

  • Ryan Eby

  • Jason Etheridge

  • Bill Erickson

  • Elaine Hardy

  • Kyle Huckins

  • Stephanie Leary

  • Tiffany Little

  • Mary Llewellyn

  • Terran McCanna

  • Gina Monti

  • Christine Morgan

  • Michele Morgan

  • Andrea Buntz Neiman

  • New Developers Working Group

  • Jennifer Pringle

  • Mike Rylander

  • Jane Sandberg

  • Chris Sharp

  • Jason Stephenson

  • Jennifer Weston

  • Beth Willis

  • Carol Witt

4. Evergreen 3.8.1

This release contains bug fixes improving on Evergreen 3.8.0

4.1. Upgrade notes

The fix for Launchpad bug 1939338 modifies the fm_IDL.xml file. To ensure that everything is up-to-date, existing Evergreen sites should run autogen.sh after restarting OpenSRF services and before restarting Apache.

4.2. Bug Fixes

4.2.1. Acquisitions

  • Protects real copies from deletion by an acqusitions line item cancel (Bug 1928003)

  • Fixes an issue where EDIWriter.pm was not correctly applying some attribute types (Bug 1930740)

  • Fixes the Providers form to be more friendly to screenreaders (Bug 1950507)

4.2.2. Administration

  • Adds rdeleted parameter to the pingest.pl script (Bug 1862652)

  • Fixes bug where Carousels could only be viewed & edited by their creating user (Bug 1939338)

  • Updates Hopeless Holds interface so Title links open in a new tab (Bug 1909681)

  • Fixes an issue where specific opensrf user is required in oils_ctl.sh and autogen.sh Bug 1900005)

  • Adds MARC_NAMESPACE to Const.pm (Bug 1930747)

  • Fixes an issue preventng correct MADS processing of field 755 (Bug 1800871)

  • Adds default columns in the Angular staff catalog View Holds tab (Bug 1907123)

  • Adds filters to MARC Coded Value Map grid (Bug 1843970)

4.2.3. API

  • Makes changes to the eBook API to support Overdrive’s updated Checkouts API (Bug 1951021)

  • Fixes issue where loading records with located URIs deleted and recreated call_numbers (Bug 1482757)

4.2.4. Architecture

  • Fixes typo in fm_idl.xml (Bug 1957840)

  • Fixes an issue where retrieving a title via SuperCat can crash if the title has a serial unit with statcats (Bug 1970486)

  • Upgrades karma in NPM dependencies (Bug 1965432)

  • Fixes variable in log_me sub (Bug 1778783)

  • Fixes material icons package error in NPM install (Bug 1969232)

4.2.5. Catalog

  • Fixes an issue in the traditional staff catalog where PLACE_UNFILLABLE_HOLD override fails if there are no items available (Bug 1906842)

  • Fixes an issue in the Patron Search from Place Holds modal where barcode search was failing (Bug 1955927)

  • Restores Hold links in the staff catalog detail page that were broken by a Chrome update (Bug 1964019)

  • Fixes an issue in the traditional staff catalog where user settings wouldn’t load in the Place Holds interface (Bug 1939426)

  • Excludes empty bibs with transcendent=f from location limited staff searches (Bug 1746800)

  • Fixes issue in the traditional staff catalog where Patron Barcode Completion didn’t populate correctly in the Place Holds interface (Bug 1965317)

  • Fixes an issue in the Angular staff catalog where monograph parts were sorting incorrectly in the Place Holds interface (Bug 1965161)

  • Adds default columns in the Angular staff catalog View Holds tab (Bug 1907123)

4.2.6. Cataloging

  • Fixes a regression where owning libraries were not indicated in the Holdings View dropdown (Bug 1739277)

  • Fixes an issue where batch deletes from an item bucket exhausted drones (Bug 1949910)

  • Fixes an issue where the Holdings View showed incorrect item counts (Bug 1933275)

  • Adds Author field to Item Buckets (Bug 1800474)

  • Fixes an issue where batch removal of items from an item bucket exhausted drones (Bug 1968082)

  • Splits Active Date and Create Date into separate columns in Angular Holdings View (Bug 1916600)

  • Adds Author field to Item Buckets (Bug 1800474)

  • Fixes copy templates setting to allow migration of copy templates from AngularJS to Angular (Bug 1951162)

  • Angular copy location editor can now pass multiple context org unit IDs (Bug 1956626)

4.2.7. Circulation

  • Excludes child organizational units when fleshing standing penalties (Bug 1959461)

  • Fixes invalidate email regression (Bug 1950826)

  • Fixes a bug where Patron Search could cause the browser to become unresponsive (Bug 1959904)

  • Fixes issue with slow user merging or deleting (Bug 1960956)

  • Fixes display issue in Hold Shelf Record Summary Detail View (Bug 1838580)

  • Adds server-side saving for Holds Groups grids (Bug 1956003)

  • Fixes download & print issue with Angular Holds Pull List (Bug 1958265)

  • Adds duplicate barcode check to Item Status Replace Barcode (Bug 1950468)

4.2.8. Client

  • Improved filtering on egBasicComboBox typeaheads (Bug 1819233)

  • Corrects print template data field names for Items Out template (Bug 1766726)

  • Implements batch method for adding users to a bucket (Bug 1946531)

  • Fixes untranslatable strings in the Historical Bills print template (Bug 1772631)

4.2.9. Course Materials

  • Adds owning library check to Course Terms uniqueness constraint (LP1942645)

  • Fixes course search issue (Bug 1913340)

4.2.10. Documentation

  • Updates to Print Template Export documentation (Bug 1929592)

  • Added Advanced Authorities documentation (Bug 1944205)

  • Corrections to Override Actions documentation

  • Updates to Barcode Completion documentation

  • Added Course Materials documentation

  • Updates to Holds documentation

  • Updates to z39.50 documentation

  • Updates to OPAC Lists documentation

  • Added relevant Conference videos to some documentation pages

  • Updates to Using the Public Access Catalog documentation

  • Updates to Billing documentation

4.2.11. OPAC

  • Fixes an issue in the Bootstrap OPAC where changing a branch did not clear the shelving location list (Bug 1946019)

  • Restores line breaks in Patron Messages (Bug 1927990)

  • Fixes an issue where some electronic resource links would not display in the Bootstrap OPAC (Bug 1950394)

  • Fixes an issue in the Bootstrap OPAC where the More Details button was not translatable (Bug 1919494)

  • Fixes an issue where a hold in the status "Hold Shelf Delay" displayed blank in the OPAC (Bug 1959405)

  • Fixes Bootstrap OPAC More Details button so it toggles to Less Details when clicked (Bug 1920039)

  • Fixes circ history CSV export in the Bootstrap OPAC (Bug 1954923)

  • Fixes color contrast on Bootstrap OPAC forms (Bug 1942240)

  • Fixes formatting in Bootstrap OPAC My Lists (Bug 1907863)

  • Fixes a bug in the Bootstrap OPAC where the self-registration library setting wasn’t honored (Bug 1958163)

  • Adds Matomo support to the Bootstrap OPAC (Bug 19668020)

  • Stopgap fix to prevent OPAC payment when zero-dollar or negative bills are present on a patron’s account (Bug 19965579)

4.2.12. Serials

  • Fixes an issue where subscription manager fetched too many parallel requests (Bug 1949389)

4.2.13. Self Check

  • Adds Preferred Name to self checkout (Bug1847827)

4.3. Acknowledgements

We would like to thank the following individuals who contributed code, testing and documentation patches to the 3.8.1 point release of Evergreen:

  • MaryAnn Alexander

  • John Amundson

  • Jason Boyer

  • Dan Briem

  • Jennifer Bruch

  • Christine Burns

  • Steve Callender

  • Galen Charlton

  • Garry Collum

  • Jeff Davis

  • Bill Erickson

  • Jason Etheridge

  • Lynn Floyd

  • Ruth Frasur

  • Jeff Godin

  • Elaine Hardy

  • Blake Graham Henderson

  • Kyle Huckins

  • Tiffany Little

  • Shula Link

  • Mary Llewellyn

  • Terran McCanna

  • Gina Monti

  • Michele Morgan

  • Andrea Buntz Neiman

  • Jennifer Pringle

  • Mike Risher

  • Mike Rylander

  • Jane Sandberg

  • Chris Sharp

  • Jason Stephenson

  • Josh Stompro

  • Jennifer Weston

  • Beth Willis

  • Jessica Woolford

5. Evergreen 3.8.0

5.1. Upgrade notes

5.1.1. New Permissions

  • UPDATE_USER_PHOTO_URL

  • CREATE_RECORD_NOTE

  • UPDATE_RECORD_NOTE

  • DELETE_RECORD_NOTE

5.1.2. Removed Permissions

  • VIEW_STANDING_PENALTY

5.1.3. New Library Settings

  • Pickup Library Soft stalling interval

  • Pickup Library Hard stalling interval

  • Void item deposit fee on checkin

  • Require Photo URL field on patron registration

  • Show Photo URL field on patron registration

  • Suggest Photo URL field on patron registration

  • My Account URL

  • Maximum number of spelling suggestions that may be offered

  • Stripe ISO 4217 currency code

  • Use Item Price or Cost as Primary Item Value

  • Use Item Price or Cost as Backup Item Value

  • Staff Catalog Search Filters

  • Workstation OU is the default for staff-placed holds

5.1.4. Backing Up Auditor alert_message Column

Warning
The upgrade script will remove the alert_message field from the auditor table, so if you care about preserving those you should run a query to create a backup.

For example:

CREATE TABLE auditor.backup_usr_alert_msg AS
   CREATE audit_id, audit_time, audit_action, audit_user,
          audit_ws, id as "usr_id", last_update_time,
          alert_message
   FROM auditor.actor_usr_history
   WHERE alert_message IS NOT NULL;

5.1.5. Reindexing for Search Suggestions

The upgrade includes a partial reindexing to update search suggestions. After running the schema upgrade script, e.g., version-upgrade/3.7.1-3.8.0-upgrade-db.sql, the reindexing can be done as follows.

First, in a psql session connected to your Evergreen database, run:

\a
\t

\o title
select value from metabib.title_field_entry where source in (select id from biblio.record_entry where not deleted);
\o author
select value from metabib.author_field_entry where source in (select id from biblio.record_entry where not deleted);
\o subject
select value from metabib.subject_field_entry where source in (select id from biblio.record_entry where not deleted);
\o series
select value from metabib.series_field_entry where source in (select id from biblio.record_entry where not deleted);
\o identifier
select value from metabib.identifier_field_entry where source in (select id from biblio.record_entry where not deleted);
\o keyword
select value from metabib.keyword_field_entry where source in (select id from biblio.record_entry where not deleted);

\o
\a
\t
\q

Then, from the command line:

$ ~/EG-src-path/Open-ILS/src/support-scripts/symspell-sideload.pl title > title.sql
$ ~/EG-src-path/Open-ILS/src/support-scripts/symspell-sideload.pl author > author.sql
$ ~/EG-src-path/Open-ILS/src/support-scripts/symspell-sideload.pl subject > subject.sql
$ ~/EG-src-path/Open-ILS/src/support-scripts/symspell-sideload.pl series > series.sql
$ ~/EG-src-path/Open-ILS/src/support-scripts/symspell-sideload.pl identifier > identifier.sql
$ ~/EG-src-path/Open-ILS/src/support-scripts/symspell-sideload.pl keyword > keyword.sql

Then finally, back in psql:

ALTER TABLE search.symspell_dictionary SET UNLOGGED;
TRUNCATE search.symspell_dictionary;

\i identifier.sql
\i author.sql
\i title.sql
\i subject.sql
\i series.sql
\i keyword.sql

CLUSTER search.symspell_dictionary USING symspell_dictionary_pkey;
REINDEX TABLE search.symspell_dictionary;
ALTER TABLE search.symspell_dictionary SET LOGGED;
VACUUM ANALYZE search.symspell_dictionary;

DROP TABLE search.symspell_dictionary_partial_title;
DROP TABLE search.symspell_dictionary_partial_author;
DROP TABLE search.symspell_dictionary_partial_subject;
DROP TABLE search.symspell_dictionary_partial_series;
DROP TABLE search.symspell_dictionary_partial_identifier;
DROP TABLE search.symspell_dictionary_partial_keyword;

5.1.6. Updating Reports on Patron Notes

The underlying data structure for patron notes has changed with all notes living in the actor.usr_message table, so report writers will need to change the following paths in existing reports:

  • actor.usr_note → all columns

  • actor.usralert_message

  • actor.usr_standing_penalty → note

And for actor.usr_message, there is now both a pub column and a deleted column.

5.1.7. Holdings Editor Preferences

Given the number of changes between the AngJS holdings editor and the new Angular interfaces, preferences stored for the AngJS interface will not be honored by the new interface. New preferences will have to be applied by staff as needed.

5.2. New Features

5.2.1. Acquisitions

Angular Rewrite of Acquisitions Administration Interfaces

Several administrative interfaces for acquisitions have been rewritten to use the Angular framework:

  • Claiming

  • Currencies and Exchange Rates

  • Distribution Formulas

  • EDI Attribute Sets

  • Fund Administration

====== Claiming ======

The interface for managing claim policies is now a single multi-tabbed page that combines the previous interfaces for:

  • Claim Policies

  • Claim Policy Actions

  • Claim Types

  • Claim Event Types

The new interface can be found in Administration > Acquisitions Administration > Claiming.

====== Currencies and Exchange Rates ======

The previous two interfaces for managing currencies and exchange rates have been consolidated into one. The new interface allows users to create, modify, and delete currency types. In addition, the list of currencies now has Manage Exchange Rates buttons to allow specifying the exchange rate from the selected currency to another one.

If an exchange is set in one direction, e.g., from USD to EUR, opening the Manage Exchange Rates for EUR will show the inverse of the exchange rate for USD as a read-only field.

The new interface can be found in Administration > Acquisitions Administration > Currencies and Exchange Rates.

====== Distribution Formulas ======

The Angular interface for managing distribution formulas displays a grid of existing formulas and allows authorized users to create, modify, and delete formulas. The dialog for editing a formula allows the user to define one or more entries containing owning library, number of items, and optionally shelving location, fund, circulation modifier, and collection code.

The new interface can be found in Administration > Acquisitions Administration > Distribution Formulas.

====== EDI Attribute Sets ======

The Angular EDI attribute sets interface is similar to the previous one. However, it includes enhancements to display the number of providers using an attribute set as well as a View Providers button to navigate to those providers.

The new interface can be found in Administration > Acquisitions Administration > EDI Attribute Sets.

====== Fund Administration ======

The new fund administration interface unifies configuration of funding sources, purchasing funds, and fund tags. The interface has three tabs:

  • Funds

  • Funding Sources

  • Fund Tags

The Funds tab displays a filterable list of funds that allows the user to create, modify, and remove funds. The fund name is hyperlinked; clicking that hyperlink opens a dialog that has the following tabs:

  • Summary: this contains summary information about the fund, including various balances.

  • Allocations: this lists allocations to and from the fund.

  • Transfers: this lists fund transfers to and from the fund.

  • Debits: this lists debits against the fund. As an enhancement from the previous version of the funds interface, the grid of debits now has links to the line item, purchase order, and/or invoice associated with the debit.

  • Tags: this lists the tags associated with the funds and allows the user to add or remove tag associations.

The fund management dialog also allows the user to create allocations into the fund and transfer money away from the fund.

The funds tab also has a Fiscal Propagation and Rollover button. The library from the selector on the funds tab is used to set the context org unit for the propagation and rollover. Upon clicking the button, a dialog box appears that allows the user to select the fiscal year to propagate or rollover, checkboxes to specify whether to also perform a fiscal year close-out and whether to limit a close-out to encumbrances, and a checkbox to specify whether or not to do a dry run. Upon completion of the propagation, the dialog will display summary results.

The Funding Sources tab displays a filterable list of funding sources and allows the user to create funding sources, apply and view credits, allocate money to funds, and view allocations.

The Fund Tags tab presents a grid that allows users view view, create, modify, and delete fund tags. Assigning a tag to a fund is done using the fund management dialog.

The new interface can be found in Administration > Acquisitions Administration > Fund Administration.

====== Other Changes ======

The following miscellaneous changes are included in this work:

  • Funds are now displayed in Angular selectors with the pattern "CODE (YEAR) (OWNING_LIBRARY)"

  • The automatically generated fund allocation note associated with fund transfers now reads "Transfer to/form fund CODE (YEAR) (OWNER)". Previously, the fund was identified only by its numeric fund ID.

  • A new style was added for display of negative money amounts. By default, these amounts display with red text.

  • The fund propagation and rollover report now includes the total amount of encumbrances that were rolled over.

  • Various dynamic Angular comboboxes will now display up to 100 entries upon a click without requiring that the user submit a search term.

  • Various Angular record editing forms will now complain if the user tries to save a field value that contains only whitespace.

  • Currency amounts in Angular are no longer displayed with a currency symbol. Prior to this change, monetary amounts were displayed with a dollar sign regardless of the intended currency.

  • Various changes were made in the IDL to adjust field labels and to mark certain fields as required.

Fund Debit Auditor Table

A new auditor table now exists for the acq.fund_debit table. This allows detailed reporting on changes to encumbrances and expenditures over time.

Miscellaneous
  • Funding sources now have an active flag. If a funding source is marked as inactive, adding credits to it or allocating from it is disabled, and it will not show up in the list of possible funding sources when allocating to a fund.

5.2.2. Administration

Case Insensitive Browse Entries

It is now possible for a system administrator to select whether a particular browse entry field’s case should be considered when determining uniqueness. A new "Browse Folding is Case-Insensitive" column has been added to the Administration → Server Administration → MARC Search/Facet Fields interface. Note that a bib record reingest will be required for changes to take effect.

Miscellaneous
  • The Search Filter Groups administration interface is now ported to Angular.

5.2.3. Cataloging

Holdings Maintenance & Item Attributes Editor Angular Port

Key differences from the AngularJS Holdings and Item Attr. editor interfaces include the following:

  • Tabbed Holdings vs. Item Attr. interfaces.

    • With option to display as a unified interface without tabs.

  • Item Attr. fields retain position when showing/hiding

  • Improve keyboard navigation of Item Attr. editor.

  • Templates are once again managed directly in the Item Attr. editor.

  • Item Attr. displays values as counts summaries with option to edit by clicking on a field (or tabbing + Enter) a la XUL.

  • Item Attr batch values support changing only items with selected values.

  • Batch value display limit vertical expansion of long lists with option for manual expansion.

  • All fields are visible by default; hidden by modifying preferences.

  • Owning Library is managed in the Item Attr editor a la XUL.

  • New feature called "Change Circ Lib When Owning Lib Changes"

  • Generate Barcodes and Use Checkdigit are visible in the main holdings form with option to hide.

  • Print Labels checkbox moved from Preferences to the save actions toolbar.

  • Option to hide various Holdings interface columns for extra horizontal space.

  • Option to temporarily expand columns in the Holdings interface for reviewing wide columns of text.

Fix for Authority Records with Long Subfields

Importing or updating authority records with long subfields, i.e. in the vicinity of 5,000 characters or more in length, can cause database errors that will prevent the update or import from happening. The error occurs because non-full text indexes in PostgreSQL have a limited length, and long fields sometimes lead to index entries that exceed this maximum value.

In order to rectify this issue, two database indexes on the authority.full_rec table’s value column have been redefined to match their counterparts in the metabib.real_full_rec table. After this update, only the first 1024 characters of an authority field or subfield will be considered by these indexes.

Note
These indexes are not used for authority record search, though they are used for sorting and paging.
Bib Record -1 Can No Longer Be Edited

Now when retrieving the bibliographic record with the id of -1 the delete button will be missing and the save button is disabled.

In addition, new database rules now protect bib record ID -1, call number ID -1 and copy location ID 1 from editing.

MARC Batch Import/Export Separate Edit Date/Editor Toggle

Adds a new field "Update Bib Edit Date" to Vandelay merge profiles which allows users to update the edit date and editor information on a merged/overlaid bib record without also having to modify the bib source.

For backwards compatibility, any existing merge profiles that have "Update Bib Source" applied will also get "Update Bib Edit Date" applied.

Browse Heading Navigation

In the Angular staff catalog, when viewing the list of bib records linked to a heading, it’s now possible to navigate to the previous or next heading directly on the bib list page without having to return to the original browse search.

Bibliographic Record Notes

Bibliographic record notes (i.e., administrative notes stored in the biblio.record_note table, not 5XX fields in the MARC record) can now be edited from the Record Notes tab. Three new permissions manage this and should be added to cataloging accounts and permission groups as appropriate: CREATE_RECORD_NOTE, UPDATE_RECORD_NOTE, and DELETE_RECORD_NOTE. There is an optional public display flag that is not yet supported in the public catalog but included to support future functionality.

5.2.4. Circulation

Granular control over how to use price and acquisition cost to determine item value

This feature adds two new library settings:

  • Use Item Price or Cost as Primary Item Value

  • Use Item Price or Cost as Backup Item Value

Which intersect the behavior of these existing settings:

  • Charge lost on zero

  • Default Item Price

  • Minimum Item Price

  • Maximum Item Price

Each of these settings affect how item price is used in various contexts and is not limited to "lost" items, but can affect notices, fine rules, and billings for long overdue and damaged items (as well as lost items).

By default, the price field on items is the only field considered by these various uses, but if we set, for example, "Use Item Price or Cost as Primary Item Value" to "cost", then we’ll use the cost field instead of the price field.

Alternately, if we set the "Backup Item Value" to "cost" and either leave the "Primary Item Value" setting unset or set to "price", then we’ll consider the price field first, and if it is either unset/null or equal to 0 (and "Charge lost on zero" is true), then it’ll fall-through to the cost field. We can also flip the behavior with these settings and consider cost first and then price second.

The primary intended use case for this feature is:

  • If there’s an acquisition cost, charge this as the lost value.

  • If there’s not an acquisition cost, but there’s a price, charge the price.

  • If neither, charge the default value.

Library selector on the holds pull list

The holds pull list screen now includes a library/org unit selector. This allows staff to view the pull list of any library where they have VIEW_HOLDS permissions, rather than having to log in to a workstation at that library.

Angular Holds Pull List

The holds pull list now uses Angular and has an address of /eg2/en-US/staff/circ/holds/pull-list.

New Item Triggered Events Log

A reimplementation of the Item Triggered Events Log interface, building on the Patron Triggered Events Log Angular reimplementation.

Template Support for Information and My Account URLs

A new setting has been added named lib.my_account_url to provide a path usable in templates to a patron’s account login. Both this and the existing lib.info_url settings are now available in the server-side processed templates, action triggers and traditional print receipts.

Web side processed templates can be found in Administration → Server Administration → Print Templates.

You can add settings using the following syntax:

<div>[% helpers.get_org_setting(staff_org.id, 'lib.info_url'); %]</div>
<div>[% helpers.get_org_setting(staff_org.id, 'lib.my_account_url'); %]</div>

Print Receipts found in Administration → Workstation → Print Templates can be added with these includes:

{{includes.info_url}}
{{includes.my_account_url}}

Action triggers can use both values with the helpers.get_org_setting include. Example:

[% helpers.get_org_setting(circ_lib.id, 'lib.my_account_url') %]
Override Dialogs

This reworks the override action dialogs in the patron display for Check Out and Items Out, and in the Circulation → Renew Items interface. It exposes the auto-override behavior as checkboxes giving staff more fine-grained control over which events are auto-forced or skipped upon subsequent encounters. It also changes the Cancel action for batch renewals to abort the remaining renewals in the batch, and makes it so that new authorization credentials provided during such a batch will be treated as an operator change for the entire batch. We also fix an existing bug where events marked as already encountered for auto-override could leak into other patron contexts via Patron Search.

New Patron Triggered Events Log

A reimplementation of the Patron Triggered Events Log interface along with supporting infrastructure for speedier results with large datasets.

Photo URL

Editing of the patron’s photo URL can now be done in the staff client’s patron registration and edit screen. A new permission UPDATE_USER_PHOTO_URL controls the ability to actually edit the field.

open-ils.circ.renew.auto Removed

The deprecated open-ils.circ.renew.auto API was removed. You will want to use open-ils.circ.renew with the auto_renewal option set to 1. This mainly affects those who have written custom code using the open-ils.circ backend.

Void Deposit Billing at Checkin

There is a new setting called "Void item deposit fee on checkin" that, when enabled, will cause items that have deposit billings to be automatically voided.

Miscellaneous
  • The patron record editor now has a button to send a password reset email to the patron’s email address.

  • Add a new pair of library settings to support pickup library-based hold stalling. Pickup Library Soft stalling interval, when set for, the pickup library, specifies that for holds with a request time age smaller than the specified interval only items scanned at the pickup library can be opportunistically captured. Example "5 days". This setting takes precedence over "Soft stalling interval" (circ.hold_stalling.soft) when the interval is in force. Pickup Library Hard stalling interval, when set for the pickup library, specifies that no items with a calculated proximity greater than 0 from the pickup library can be directly targeted for this time period if there are local available copies.

  • Add a new library setting, Workstation OU is the default for staff-placed holds, to indicate that the workstation OU should be set as the default pickup location for hold requests that are placed via the staff interface. The process for setting the default pickup location is now:

    1. Workstation if the Workstation OU is the default for staff-placed holds setting is turned on

    2. The user’s preferred pickup location, if set

    3. if the user’s preferred pickup location is not set, the Workstation if the Workstation OU fallback for staff-placed holds setting is turned on

    4. Otherwise, it defaults to the user’s home library.

5.2.5. Client

Consolidate Patron Notes, Alerts, and Messages

Patron notes, messages, alert messages, and standing penalties have been folded into one Notes interface. Notes designated as public will show in the My Account → Message Center in the public catalog for patrons.

The underlying data structure has also changed with all notes living in the actor.usr_message table, so report writers will need to change the following paths in existing reports:

  • actor.usr_note → all columns

  • actor.usralert_message

  • actor.usr_standing_penalty → note

And for actor.usr_message, there is now both a pub column and a deleted column.

Depending on privacy policies, system administrators may wish to set up a recurring process to truly delete older entries in actor.usr_message that have been flagged as deleted.

Warning
The upgrade script will remove the alert_message field from the auditor table, so if you care about preserving those you should run a query to create a backup.

For example:

CREATE TABLE auditor.backup_usr_alert_msg AS
   CREATE audit_id, audit_time, audit_action, audit_user,
          audit_ws, id as "usr_id", last_update_time,
          alert_message
   FROM auditor.actor_usr_history
   WHERE alert_message IS NOT NULL;

The addition of the Angular Staff Catalog surfaced a double-encoding issue with redirects in certain Apache versions. This caused searches for multiple words to have %20 in place of spaces, almost certainly resulting in 0 results.

In order to apply this fix, change the Angular redirects in eg_vhost.conf from

RewriteRule ^/eg2/(.*) https://%{HTTP_HOST}/eg2/en-US/$1 [R=307,L]

to

RewriteRule ^/eg2/(.*) https://%{HTTP_HOST}/eg2/en-US/$1 [NE,R=307,L]
Miscellaneous
  • In the Angular staff catalog, rename Catalog Preferences to Search Preferences and add a return button.

  • Angular grids now have a have a Manage Actions Menu configuration action to allow users to control which actions are displayed on the context menu for the grid.

  • The item table and holdings view in the Angular staff catalog record details page now include Total Circ Count and Last Circ Date columns.

  • There is a new library setting, Staff Catalog Search Filters, that can be used to customize the list of search filters that are available on the Angular staff catalog advanced search form. This setting takes an array of desired filters, e.g., ["item_lang","audience","lit_form"]. The complete list of available filters is item_type, item_form, item_lang, audience, vr_format, bib_level, and lit_form. If the library setting is not set, all of the filters are displayed.

5.2.6. Public Catalog

Credit card payments using Stripe now implemented with PaymentIntents instead of Charges

This changes the Stripe code in the public catalog to use their PaymentIntents and confirmCreditCard API, which is recommended over their Charges API. Credit card charges are no longer finalized (captured/confirmed) on Evergreen’s backend, though the backend does check whether a payment was made successfully before recording it.

Miscellaneous
  • The Bootstrap public catalog now displays cover images on the My Account items checked out, check out history, holds, and holds history pages.

  • Carousels on the public catalog home page now take up 80% of the page width by default rather than just 40%.

5.2.7. Reports

Reporter Item Statistics View

A new reports source, Item Statistics View is available. Certain third-party products such as collection development management providers require copy statistics that are not readily available in a single report. This view adds those, which will also benefit library staff reports generally.

To add the view, a system administrator will need to (re-)run the example.reporter-extension.sql script, which will create the new view in the database.

Hold/Copy Ratio Report Source Changes

This standardizes how the existing Hold/Copy Ratio reports sources count holdable copies; notably, metarecord copies are no longer counted in these report sources and all sources now use action.hold_copy_map.

Any reports using these sources will need to be rewritten.

A new source that breaks out counts by patron home library was also added, named Hold/Copy Ratio per Bib and Home Library.

Add Dewey Call Number Blocks and Ranges to Reports

A new view is added to the reporter with links from Call Number that will allow users to display or filter on the Dewey 10’s or 100’s block or range that a call number falls within. They can be accessed by following the "Dewey Classification" link from Call Number.

More Granular Age Divisions for Reports

Reports now include an option for more detailed age divisions for users based on the entered date of birth. Divisions include:

  • Child 0-5 Years Old

  • Child 6-12 Years Old

  • Teen 13-17 Years Old

  • Adult 18-25 Years Old

  • Adult 26-49 Years Old

  • Adult 50-59 Years Old

  • Adult 60-69 Years Old

  • Adult 70+

This new column is accessible from ILS User → Demographic Info and the new field is named "Detailed Age Division".

5.3. Acknowledgments

The Evergreen project would like to acknowledge the following organizations that commissioned developments in this release of Evergreen:

  • CW MARS

  • Evergreen Community Development Initiative

  • NOBLE

  • PaILS

  • Westchester Library System

We would also like to thank the following individuals who contributed code, translations, documentations, patches, and tests to this release of Evergreen:

  • Adam Bowling

  • Andrea Buntz Neiman

  • Angela Kilsdonk

  • Beth Willis

  • Bill Erickson

  • Blake Graham-Henderson

  • Chris Sharp

  • Christine Burns

  • Christine Morgan

  • Chrisy Schroth

  • Dan Briem

  • Dawn Dale

  • Elaine Hardy

  • Erica Rohlfs

  • Galen Charlton

  • Garry Collum

  • Gina Monti

  • Jane Sandberg

  • Jason Boyer

  • Jason Etheridge

  • Jason Stephenson

  • Jeff Davis

  • Jeff Godin

  • Jennifer Bruch

  • Jennifer Pringle

  • Jennifer Weston

  • Jessica Woolford

  • John Amundson

  • Josh Stompro

  • Katie G. Martin

  • Kyle Huckins

  • Lindsay Stratton

  • Lisa Carlucci

  • Lynn Floyd

  • Mary Llewellyn

  • Michele Morgan

  • Mike Risher

  • Mike Rylander

  • Rogan Hamby

  • Rosie Le Faive

  • Ruth Frasur

  • Seth Erickson

  • Shula Link

  • Stephen Wills

  • Terran McCanna

  • Tiffany Little

  • Verbio Group

We also thank the following organizations whose employees contributed patches:

  • BC Libraries Coop

  • Bibliomation

  • Catalyte

  • CW MARS

  • Emerald Data

  • Equinox Open Library Initiative

  • Georgia Public Library Service

  • Greater Clarks Hill Regional Library

  • Indiana State Library

  • Kenton County Library

  • King County Library System

  • Linn Benton Community College

  • MOBIUS

  • NOBLE

  • PaILS

  • Sigio

  • University of Prince Edward Island

  • Westchester Library System

We regret any omissions. If a contributor has been inadvertently missed, please open a bug at http://bugs.launchpad.net/evergreen/ with a correction.