1. Supported platforms

The following Linux distributions are well-tested:

  • Debian 7 (Wheezy) and 8 (Jessie)

  • Ubuntu 14.04 (Trusty Tahr) and 16.04 LTS (Xenial Xerus)

2. OpenSRF 2.5.1

OpenSRF 2.5.1 was released on 11 September 2017. It is a major bugfix release that also includes a minor enhancement. All users of OpenSRF 2.5.0 are advised to upgrade as soon as possible.

2.1. Enhancements in 2.5.1

2.1.1. osrf_control --diagnostic now reports max_children values (LP#1711194)

osrf_control --diagnostic now includes the maximum number of drones allowed per service, making it easier to determine if drone usage is hitting limits.

For example:

* opensrf.math             [436] uptime=07:31:42    cputime=00:00:00    #drones=1/15   6%
* opensrf.settings         [32712] uptime=07:31:46    cputime=00:00:00    #drones=5/15  33%

2.2. Major bugfixes in 2.5.1

2.2.1. Fixes to bundling and chunking (LP#1709710)

The calculations of whether to split a large message into multiple chunks now take into account additional overhead added by the JSON- and XML-escaping of certain characters. As a consequence, large messages are now much less likely to overflow typical ejabberd max_stanza_size values.

2.2.2. Premature drone shutdown now less likely to take down listener (LP#1697029)

The premature failure of a drone process that was just starting up, as might happen if certain ejabberd limits are reached, is now less likely to cause a listener process (and thus the entire service) to abort.

2.3. Other improvements in 2.5.1

Several improvements were made to the installation process:

  • Remove check of httpd.conf from Makefile.install (LP#1690206)

  • Ensure make install respects DESTDIR (LP#1704090)

  • Update WebSockets instructions for Debian Jessie (LP#1703958)

  • Fix intermittant failure of parallel buidling (LP#1704116)

Graham Billiau has also been working on a new port of OpenSRF to Gentoo.

2.4. Acknowledgements

We would like to thank the following people who contributed to OpenSRF 2.5.1:

  • Bill Erickson

  • Chris Sharp

  • Galen Charlton

  • Graham Billiau

  • Jason Stephenson

  • Mike Rylander

3. OpenSRF 2.5.0

OpenSRF 2.5.0 was released on 21 March 2017.

3.1. New features in 2.5.0

3.1.1. Chunking and bundling (LP#1612771)

Message Bundling and Chunking

OpenSRF now supports message chunking, i.e., breaking up large OpenSRF messages across multiple XMPP envelopes. This is implemented with a new OpenSRF message type.

C, Perl, and Javascript libraries are taught how to reconstruct chunked messages. The default chunking threshold is 50Kb, just a bit below the default ejabberd max stanza size of 64Kb.

What was previously called chunking is now referred to as bundling: packing multiple OpenSRF messages together in a single XMPP envelope, as long as we believe more messages will be sent in the future and we are below some threshold of combined message size. The default for that threshold is 25Kb.

With this change, it is no longer necessary to change the max_stanza_size setting for ejabberd when installing OpenSRF.

3.1.2. Pass client timezone to server (LP#1485371)

OpenSRF has long inspected the envelope of incoming requests for information about the client’s locale and made this information available to business logic.  This is used, among other things, to drive transparent translation of in-database strings within Evergreen.  In addition to locale, OpenSRF will now respect client-supplied adjustment to the effective time zone in which it operates, and provide that information to the business logic layer of applications built on the framework.

3.1.3. Client

As most clients that have time zones which differ from that of the server on which the OpenSRF processes run are, in fact, web browsers, it is necessary to include time zone detection directly within the browser.  This will be stored in a cookie to be sent with all subsequent HTTP requests, and used in all OpenSRF-over-HTTP calls made using the JavaScript bindings for OpenSRF, including those for WebSockets communication.

For non-browser clients, such as support scripts written in Perl or other scripting languages, the local system’s mechanisms for detecting time zone is relied upon.  For instance, Perl scripts can directly read the TZ environment variable.

Additionally, the srfsh client now reads its local time zone from the environment and passes that to the server.

3.1.4. Server

Within OpenSRF services implemented in Perl, this information is now passed up to the business logic layer via the TZ environment variable, and is reverted to the server’s value at the end of each request.  This allows automatic, transparent use of the client’s time zone in almost all cases, and provides a system-normal access mechanism when direct access is required.

For OpenSRF services implemented in C, the time zone information is provided as part of the request context object that is passed to implementation functions.  In particular, this allows services that interact with a database to set the time zone in which the database interprets timestamps to that of the client.

3.1.5. Dispatch mode for method_lookup subrequests (LP#1631522)

There is a pattern in the wild of using OpenSRF’s method_lookup() facility to decide between one of several local methods when delegating to pre-existing logic. Often times, we want to simply hand control over to another method, but the output of a subrequest’s run() is an array of results. The caller has to know if, and how, to restructure the result for the client.

Instead, we can now call dispatch() instead of run() and have OpenSRF session control completely passed to the delegate code. This way, the delegate code need not know anything about its caller, and vice versa.

3.1.6. Example proxy server configurations (LP#1638651, LP#1648188, and LP#1666706)

OpenSRF 2.5 comes with example configurations for using HAProxy or NGINX as a reverse proxy for HTTP, HTTPS, and WebSockets traffic. This can be useful for Evergreen systems that wish to use port 443 for both HTTPS and secure WebSockets traffic.

Along with the example configuration files, there is now a new configure option, --with-websockets-port, to allow installers to specify the WebSockets port that JavaScript clients should use.

3.1.7. Allow admin to specify where perl modules will be installed (LP#1631520)

Add --with-perlbase option to the configure to specify an alternative location for installing the Perl modules. This can be useful for setups that want to run the Perl modules from a shared filesystem or environments that need to run multiple versions of OpenSRF simultaneously.

Users of --with-perlbase are responsible for ensuring that PERL5LIB is set appropriately.

3.2. Other changes

  • Drop support for Debian Squeeze (LP#1559121)

  • Drop support for Ubuntu Precise (LP#1603708)

  • Add support for Ubuntu Xenial (LP#1551090)

  • Fix a bug with syslog configuration (LP#1473479)

  • Fix OpenSRF debian_sys_config order for Debian (LP#1585041)

  • Improvements to the installation documentation (LP#1382038, LP#1670045, and LP#1672926)

  • Improve normalization of memcache keys to avoid potential denial of service and privilege escalation attacks. (LP#1652382)

  • Fix an infinite recursion bug in opensrf.system.method.all. (LP#1652122)

  • Propagate bundling/chunking limits to subrequests. (LP#1655449)

  • Add a way for mod_perl handlers that are OpenSRF clients to detect when the web browser has disconnected, and in turn stop listening for results from XMPP requests pending when the browser disconnect happened. (LP#1616501)

  • Remove Fedora from the list of well-tested platforms. The installation target for Fedora still exists, but needs work.

  • The default configuration files shipped with OpenSRF no longer include support for insecure WebSockets. (LP#1667091)

3.3. Acknowledgements

We would like to thank the following people who contributed to OpenSRF 2.5.0:

  • Ben Shum

  • Bill Erickson

  • Chris Sharp

  • Dan Scott

  • Galen Charlton

  • Jason Etheridge

  • Jason Stephenson

  • Jeff Davis

  • Kathy Lussier

  • Mike Rylander

  • Remington Steed