Change Log

GreenArrow Engine 4.1.227

New Features & Improvements

Lowered the dynamic defaults for apache_max_clients and passenger_max_requests_in_queue, reducing overall memory utilization.

See this release’s upgrade instructions for more details.

GreenArrow Engine 4.1.226

New Features & Improvements

• Include /var/hvmail/control/httpd.ssl.custom.conf in all HTTPS VirtualHost definitions. Previously, it was only included in the default HTTPS VirtualHost’s definition. See this release’s upgrade instructions for details.
• Update PostgreSQL to version 9.5.14.
• Update OpenSSL to 1.0.2p.
• Update Apache HTTP Server to version 2.4.34.

GreenArrow Engine 4.1.224

New Features & Improvements

• Update of bounce processing rules.
• hvmail_migrate will now fail if any service starting, stopping, or restarting fails.
• Respond more gracefully if corrupted files are encountered while starting up the ram-queue.

Bug Fixes

Fixed two Ubuntu 18.04 specific bugs:

• A bug in hvmail_check_config that caused it to report the wrong status of the NTP service.
• A bug in GreenArrow’s startup script which could cause the service greenarrow start and service greenarrow stop commands to fail. /etc/init.d/greenarrow start and /etc.init.d/greenarrow stop continued to work.

GreenArrow Engine 4.1.223

New Features & Improvements

• Connections will no longer be reused with reuse_connections if the previous connection did not succeed.
• GreenArrow Engine’s version is now displayed next to the copyright statement on each of its web pages.

Bug Fixes

• Adding sending process restart that was missing from 4.1.221.

GreenArrow Engine 4.1.222

Bug Fixes

• Fix migration errors when initializing a new installation.

GreenArrow Engine 4.1.221

New Features & Improvements

• Add a new PowerMTA® Configuration Converter.
• Performance enhancement that makes receiving messages through SMTP more CPU efficient.
• Add a new optional fast-path email injection option that is more CPU efficient. This is enabled by setting *_FASTPATH options on the IPs Authorized to Relay or SMTP Services level.
• Add a new message batching feature for SimpleMH and GREENARROW_RAW_INJECTION_FASTPATH that is more CPU efficient.
• Domains, including for throttle rules in the UI, throttle rules in the API, and domain directives in the configuration file, may be defined using sub-domain wildcard matching [*.]example.com and *.example.com.
• The definition of strings that may be defined in the configuration file without encoding has been expanded.
• A new command-line option greenarrow_config domain_settings to review per-domain settings has been added.
• Update spam complaint processor to handle a specific type of malformed spam complaint.
• Update GNU tar from 1.29 to 1.30.

New Configuration Options

DKIM keys may now be specified in the configuration file for PowerMTA compatible DKIM signing. This will ease the migration from PowerMTA.

• pcompat_dkim_key
• pcompat_dkim_sign
• pcompat_dkim_identity

Options to control STARTTLS are now included in greenarrow.conf and are configurable on a per-domain basis:

• starttls_use
• starttls_require
• starttls_require_action

Options to override delivery overrides and error handling are now included in the configuration file and are configurable on a per-domain basis:

• delivery_override
• smtp_route
• message_transfer_timeout_action
• message_transfer_response_timeout_action

New logging options have been added to print detailed information about outgoing SMTP connections. Each of these options may be enabled either globally or on a per-IP or per-domain basis, allowing for some truly flexible troubleshooting!

• log_dns
• log_smtp_connections
• log_smtp_commands
• log_smtp_hexdump

Enable define_virtual_mtas_in_config_file to define VirtualMTAs (IP Addresses, Relay Servers, and Routing Rules) to be defined in the configuration file instead of through the web user-interface or API.

Domain macros may be defined with the domain_macro directive. These macros provide an easy way to reuse lists of domain names within the configuration file.

The GreenArrow configuration file may now merge in directives from other files using the include directive. We particularly recommend using this directive when you have automation that generates configuration.

Removed Configuration Options

Support for the following configuration files has been removed. In almost every case, they were not used:

• /var/hvmail/control/tls.tlsclientciphers
• /var/hvmail/control/tls.clientcert.pem
• /var/hvmail/control/tls.tlshosts/<FQDN>.pem
• /var/hvmail/control/tls.tlshosts/exhaustivelist
• /var/hvmail/control/tls.notlshosts/<FQDN>

See the starttls_use, starttls_require, and starttls_require_action directives for more information on enabling/disabling TLS on a per-IP and/or per-domain basis.

Changes to Services

The following services will no longer start until the PostgreSQL service is running and available for incoming connections:

• /service/hvmail-event-processor
• /service/hvmail-config-agent
• /service/hvmail-dd-logreader
• /service/hvmail-logfile-agent
• /service/hvmail-logfile-summary
• /service/hvmail-logfile-writer
• /service/hvmail-simplemh
• /service/hvmail-rspawn-limiter
• /service/hvmail-ram-qmail-send
• /service/hvmail-disk-qmail-send
• /service/hvmail-bounce-qmail-send

The following services will no longer start until both the PostgreSQL and Redis services are running and available for incoming connections:

• /service/hvmail-bounce-processor
• /service/hvmail-dd-dispatcher
• /service/hvmail-simplemh2
• /service/hvmail-studio-worker

Bug Fixes

• The greenarrow_config show_dynamic_defaults command was showing the wrong value for studio_message_generation_processes_per_campaign and it was not showing studio_workers_shared at all.

GreenArrow Engine 4.1.218

New Features & Improvements

• Make a new variable (is_first_attempt) available to custom code that’s run during delivery attempts.
• Add postgres_max_connections to the greenarrow_config show_dynamic_defaults output.
• Add support for Ubuntu 18.04.
• Update PHP to version 5.6.36.
• Update PostgreSQL to version 9.5.13.
• Update Pure-FTPd to version 1.0.47.

Bug Fixes

• Update Passenger to version 5.3.2. Prior to this update, a bug could cause an “Internal Server Error” message to be displayed on some of GreenArrow’s web pages.

GreenArrow Engine 4.1.217

Bug Fixes

• Fix bug in SimpleMH which caused the “Automatically Seed Mailings” feature to send emails to seed list addresses that used actual subscriber email addresses in the To: header.

GreenArrow Engine 4.1.216

New Features & Improvements

• Add new greenarrow.conf configuration file. This configuration file provides a number of new configuration options related to performance and SMTP deliveries.
• Add the ability to deliver more than one message per outgoing SMTP session. Previously, GreenArrow always attempted to deliver one message per SMTP session. With this update, it still only attempts to deliver one message per session by default.
• Add the greenarrow_status command.

GreenArrow Engine 4.1.213

New Features & Improvements

• Update the Apache HTTP Server to use GreenArrow’s OpenSSL libraries, rather than the libraries provided by the OS, and be more resilient to unclean shutdowns.

GreenArrow Engine 4.1.212

New Features & Improvements

• Normalize some variants of deferral and bounce messages returned by Gmail, Outlook.com, and Netzero. This aggregates some messages in stats which previously had unique entries.
• Add support for the dkim.global_header config file, which is used by Studio and SimpleMH.
• Update PHP to 5.6.34.
• Update Apache HTTP Server to 2.4.33.
• Add support for /var/hvmail/control/opt.notify_on_backoff config file. This causes notification emails to be sent any time a throttling program begins or ends backoff mode.

Bug Fixes

• Fix bugs in hvmail_server_migration script which could cause the script to incorrectly exit with an error.

GreenArrow Engine 4.1.210

New Features & Improvements

• Update SimpleMH to allow for Mail Classes and Instance IDs to be set via SMTP AUTH username. This takes lower precedence than the X-GreenArrow-MailClass and X-GreenArrow-InstanceID headers.
• Add new configuration options for turning SMTP AUTH on and off on a per-SMTP-service level. New installations made from this point forward have SMTP AUTH disabled by default on port 25. Older installations have SMTP AUTH enabled on that port by default. All installations have SMTP AUTH enabled on port 587 by default.
• Update of bounce processing rules.
• Update the list of root nameserver IPs used by the DNS Cache. Two of these IPs changed since the previous update.
• Update PostgreSQL to 9.5.12.

Bug Fixes

• Fix a bug which prevents the X-GreenArrow-DKIM header from being honored for messages that SimpleMH sends to a seedlist.
• Fix a bug which causes the setting for hiding internal sends to be set to its default value (true) during every package update.

GreenArrow Engine 4.1.209

New Features & Improvements

• Enable STARTTLS support by default for the SMTP2 and SMTP3 services. This change in defaults is for new installs only.
• Enable SimpleMH by default on the SMTP2 and SMTP3 services. This change in defaults is for new installs only.
• Update bounce processor to decode Base64 content-transfer-encoded messages.
• Update of bounce processing rules.
• Update PostgreSQL to 9.5.11.

GreenArrow Engine 4.1.207

New Features & Improvements

• Improve the performance of displaying SimpleMH click tracking stats.

Bug Fixes

• Fix rendering bug introduced in 4.1.206 which caused SMTP deferral message reports to have too dark of a background.
• Fix a bug introduced in 4.1.202 that caused a syntax error when viewing stats for a campaign that has SimpleMH click tracking, but no opens logged.

GreenArrow Engine 4.1.206

New Features & Improvements

• Update web interface appearance.
• Update of bounce processing rules.

Bug Fixes

• Fix a bug which causes new installations to set store_bounce_details_length equal to 0 in the bounce_processor.conf configuration file the first time they’re upgraded.

GreenArrow Engine 4.1.202

New Features & Improvements

• Add support for the Debian 9 Linux distribution.
• Update PHP to 5.6.33.
• Update PostgreSQL to 9.5.10.
• Update OpenSSL to 1.0.2n.
• Update of bounce processing rules.

Bug Fixes

• Update SimpleMH click tracking to better handle un-escaped newlines in URLs.

GreenArrow Engine 4.1.201

New Features & Improvements

• Update of bounce processing rules.

Bug Fixes

• Fix an issue which caused Ubuntu 16.04 to fail to start GreenArrow’s HTTP server when the libpq5 package is installed.
• Allocate more memory to the DNS Cache. This resolves an issue where the cache would start, but then fail to produce a full response to some queries on some Ubuntu 16.04 servers.

GreenArrow Engine v4.1.199

New Features & Improvements

• GreenArrow Engine has a new SMTP delivery program called greenarrow-remote, which is enabled by default starting with this release. It offers substantially increased delivery performance.

  The new program greenarrow-remote checks /etc/hosts before performing a DNS lookup when it needs to resolve the A or CNAME record referenced by an MX record. This is a departure from GreenArrow’s historical behavior, which ignored /etc/hosts in this context.

• New configuration option in event processor when communicating using custom_sql - replace_non_ascii. See the event processor documentation for more information.

• Update the behavior of the /var/hvmail/control/timeoutremote configuration file. See Timeout in Connections to Remote SMTP Servers for details.

GreenArrow Engine v4.1.198

New Features & Improvements

• The definition of the bounce processor configuration field store_bounce_details_length has been changed from specifying the number of bytes to instead be the number of characters.

Bug Fixes

• Enhancements of 4.1.197’s bounce processor bug fix

GreenArrow Engine v4.1.197

Bug Fixes

• Fix a bug in bounce processor which could cause it to run out of memory.

GreenArrow Engine v4.1.196

New Features & Improvements

• Update the Apache HTTP Server to version 2.4.29.
• Disable the RC4 cipher in GreenArrow’s default Apache configuration. See RFC 7465 for our reasons for doing this. This breaks HTTPS compatability with Internet Explorer 8 and earlier, which appear to have under a 1% market share.

GreenArrow Engine v4.1.193

New Features & Improvements

• Update the HTTP Submission API to support specifying a custom Return-Path.

GreenArrow Engine v4.1.192

New Features & Improvements

• New Dynamic Delivery Charts are here! See our Dynamic Delivery Statistics documentation for more information.
• Add --no-exit-on-error option to hvmail_server_migration and update migration documentation to use it. This allows the script to run to completion on servers where GreenArrow is still running and modifying files.
• Improve the process of restarting the ram-queue and bounce-queue. Corrupted messages saved to disk will now be skipped

Bug Fixes

• Fix error encountered with UTF-8 in bounce messages.

GreenArrow Engine v4.1.191

Bug Fixes

• Fix a bug in SimpleMH that causes unsubscribes to be registered as opens. This bug was introduced in version 4.1.188. Historical open and unsubscribe stats are fixed as part of the bugfix.
• Fix a bug where SimpleMH Bad Address Suppression (a) did not take into account ListID values set by the X-GreenArrow-ListID header and (b) ListID values with uppercase characters would prevent email from being suppressed.

GreenArrow Engine v4.1.189

New Features & Improvements

• Increase the default value for Passenger’s PassengerMaxRequestQueueSize setting from 100 to 1000. This allows servers that are disk IO bound to respond more gracefully to spikes in web requests.
• Replace netscape.net with yahoo.com in the default list of spam complaint domains shown in campaign stats.
• Upgrade from OpenSSL 1.0.2k to 1.0.2l.

GreenArrow Engine v4.1.188

Bug Fixes

• Fix a SimpleMH click tracking bug that impacts links containing a question mark character in the anchor/fragment. (For example: http://site.com/#/thing/?foo=123).

GreenArrow Engine v4.1.186

New Features & Improvements

• Update PHP to 5.6.31.
• Update PostgreSQL to 9.5.8.
• Make PostgreSQL’s vacuum settings more aggressive.

Bug Fixes

• Fix a bug in migration procedure which could lead to losing customizations made to PHP’s php.ini configuration file.
• Fix a bug in migration procedure which could cause Studio’s web interface to be offline following a migration.
• Fix a bug which causes emails that should be suppressed by SimpleMH’s Bad Address Suppression to instead redirect to addresses @badaddress.discardallmail.drh.net when using a relay server.
• Fix a bug which causes the bounce processor’s configuration validator to reverse the validations for ListIDs and ListID prefixes. The bug could cause the bounce processor to either reject a valid configuration because of a ListID entry or accept a configuration that it should not have because of an invalid ListID prefix entry.

GreenArrow Engine v4.1.184

New Features & Improvements

• Add verizon.net to the AOL grouping of the default throttle template. Previously verizon.net was not explicitly listed, so it would have used the default throttling rule. This change is automatically applied for all cloud customers and new on-premise customers. Existing on-premise customers may make the change by editing their throttling settings.
• Add deliver_as_if_to_domain to the /var/hvmail/control/opt.pre_delivery_attempt_hook hook.

Bug Fixes

• Update greenarrow-remote to skip quoting on email addresses that contain non-consecutive dots (.). Email addresses that contain consecutive dots (..) will continue to be quoted.

GreenArrow Engine v4.1.183

New Features & Improvements

• Add new bounce processing rules.
• Allow messages injected using the HTTP Submission API to have a unique identifier other than the Message-ID assigned. See the id field.
• If a message is injected using the HTTP Submission API which contains a Message-ID header that omits <> brackets, don’t report it back as the Message-ID or overwrite it with a new Message-ID header.

Bug Fixes

• Fix a bug in hvmail_init that could sometimes prevent the MTA from shutting down fast enough.
• Remove the duplicate clicktrackingid column from the events table. The click_tracking_id column is now consistently used to store the Click Tracking ID, whereas previously, the clicktrackingid and/or click_tracking_id columns were used, depending on the event type.
• Fix a bug which could cause an error enabling recent Engine web interface updates on systems which use a non-default PostgreSQL schema name.
• greenarrow-remote will now properly quote email addresses in the “MAIL FROM” and “RCPT TO” SMTP commands.

GreenArrow Engine v4.1.182

New Features & Improvements

• Update Apache to version 2.4.27.
• Update Perl to version 5.26.0-0.
• Add support for Ubuntu 16.04.
• When a message gets moved from the ram-queue to disk-queue, wait approximately 400 seconds before making the first disk-queue delivery attempt. There previously was not a pause. See Retry Schedule for details on when retries occur.

GreenArrow Engine v4.1.175

Bug Fixes

• Fix redirection to “Domains” UI.

GreenArrow Engine v4.1.174

New Features & Improvements

• Add STARTTLS support to greenarrow-remote. This is controlled via the /var/hvmail/control/tls.starttls_delivery_enable control file.
• Update greenarrow-remote to connect using SMTPS TLS when the destination port is 465.
• New user interfaces for Domains, Mail Classes, DKIM Keys, URL Domains, and Database Connections.

GreenArrow Engine v4.1.173

Bug Fixes

• Fix a bug introduced in 4.1.164 which could prevent Event Notification System delivery_attempt events from being recorded if non-UTF-8 Unicode characters are encountered.
• Fix a bug which could prevent the MTA from starting in some circumstances.

GreenArrow Engine v4.1.172

New Features & Improvements

• Update bounce processor’s bounce definitions database.
• Update to PostgreSQL 9.5.7.

GreenArrow Engine v4.1.171

Bug Fixes

• Fix a bug introduced in 4.1.166 which can cause Engine to fail to start due to a missing /var/hvmail/postgres/default/data/ok file. Servers which are impacted by this bug should either be upgraded or have an empty /var/hvmail/postgres/default/data/ok file created.

GreenArrow Engine v4.1.170

New Features & Improvements

• Apply a global statement_timeout of 24 hours to the PostgreSQL server.

Bug Fixes

• Bugfixes for Event Notification System delivery_attempt events and the Delivery Attempt Logging system:

  • If there was more than one delivery attempt per second, delivery_attempt events could be duplicated or not get created.

  • Local delivery attempts were never included, even if configured.

GreenArrow Engine v4.1.168

New Features & Improvements

• New configuration file (/var/hvmail/control/bounce_processor.conf) which allows for configuration of GreenArrow’s bounce processor.

GreenArrow Engine v4.1.166

New Features & Improvements

• Add a new invocation to hvmail_set (hvmail_set ramdisk_size auto), which automatically sizes the ram-queue and bounce-queue based on the amount of RAM detected.
• Make hvmail_init status run faster.

Bug Fixes

• Fix a bug intoduced in Engine 4.1.148 which causes SimpleMH engine_unsub events to be incorrectly recorded as unsub events by the Event Notification System. This bug does not impact Bad Address Suppression or Studio unsubscribes. Customers who process engine_unsub events should back process any missed unsub events. Contact GreenArrow technical support if you’d like assistance.
• Fix a bug which causes some “Challenge response” bounces to be incorrectly classified as non-bounces. Neither classification causes subscribers to be deactivated, so the extent of this bug’s impact is that it causes bounce stats to be off for these types of bounces.
• Add Mail Class name and ListID validations to prevent the creation of Mail Classes that conflict with Studio.
• Fix a bug which can cause Studio campaigns with attachments to fail to send in some circumstances.
• Fix a bug which can cause Studio sends to sometimes get stuck if the ram-queue is stopped and restarted mid-campaign.

GreenArrow Engine v4.1.165

New Features & Improvements

• Add a server migration procedure.
• Update the unmanaged backup script to exclude the DNS cache’s logs and not display a warning if files are removed before tar backs them up.
• Add the ability to control Message-ID behavior of messages injected using the HTTP Submission API.
• Change default maximum bounce message size to 100KB in order to reduce memory usage. This setting was previously 0 (unlimited).
• When processing a bounce message, replace octets that are not valid UTF-8 characters with the Unicode Replacement Character U+FFFD.
• Add the ability to track user agents for SimpleMH clicks and opens.
• Upstream software update from Ruby

Bug Fixes

• Fix a bug which causes the ram-queue to get stuck in specific circumstances. Servers which experience this problem should be updated to include this bugfix. A temporary workaround until the bugfix is installed is to run the hvmail_init restart command when the ram-queue gets stuck.
• Fix a bug which causes a false error to be reported when stopping GreenArrow on CentOS 7.
• Fix a PHP undefined index error that started appearing in part of Engine’s web interface after the update to PHP 5.6.30.
• Fix a bug which prevents the Event Processor from running multiple concurrent threads.

GreenArrow Engine v4.1.164

New Features & Improvements

• Add a new system which writes delivery attempts to a log file. This is disabled by default.
• Add the delivery_attempt event type to the Event Notification System. This event type records delivery attempts. It is disabled by default.
• Update the unmanaged backup script so that it suppresses notifications of errors logged by tar when it detects that a file changed while being backed up.
• Upstream software updates from Ruby, Redis, phpredis and PHPMailer.
• Update bounce processor’s bounce definitions database.

Bug Fixes

• Fix a bug which prevents the PHP update in Engine 4.1.162 from being performed for some Linux distributions.
• Stop the HTTP submission API from inserting a new X-Mailer header into each email that it receives.

GreenArrow Engine v4.1.162

New Features & Improvements

• Update Apache HTTP Server to 2.2.32
• Update PHP to 5.6.30

GreenArrow Engine v4.1.160

New Features & Improvements

• Add support for the X-GreenArrow-DKIM header, which allows Studio and SimpleMH mail to be DKIM signed multiple times. This header is not supported for Raw Injection at this time.
• Make the disk queue service start up faster on servers with slow disks and/or a large number of deferred messages in the queue.

GreenArrow Engine v4.1.159

New Features & Improvements

• Update to PostgreSQL 9.5.6.
• Update to OpenSSL 1.0.2k.

Bug Fixes

• Fix a bug in the bounce processor that causes bounces to be committed to PostgreSQL in batches of 20, rather than individually. This bug has a negative performance impact in some situations.

GreenArrow Engine v4.1.157

Bug Fixes

• Fix a bug in bounce processor which would cause List-Unsubscribe emails from GreenArrow Studio to be incorrectly processed as bounces instead of unsubscribes. The bug caused reporting issues but did not prevent subscribers from being deactivated.
• Fix a bug where the UID and GID were reversed in a Direct Injection library.

GreenArrow Engine v4.1.156

New Features & Improvements

• Add new regular expressions to bounce processor.

Bug Fixes

• Prevent SimpleMH from creating Return-Paths more than 64-characters long. Return-Paths longer than 64 characters were rejected by a minority of SMTP servers.
• Fix a bug introduced in Engine 4.1.153 which would cause the bounce processor to exit because it thought that its parent process had exited. This happened in environments which prevented users from seeing the processes being run by other users.
• Fix a bug triggered by a blank file in a multilog directory.

GreenArrow Engine v4.1.155

Bug Fixes

• Fix a critical bug in bounce processor introduced in v4.1.153.

  In the new bounce processor, bounces and spam complaints in a Maildir queue were processed extremely slowly (no faster than 1 message every 40 seconds).

  This affected the system in the following ways:

  If /var/hvmail/control/bounce.queue_type was set to maildir (which is not the default), bounces would be processed slowly.

  When using the redis bounce queue (which is the default) any messages that were in the Maildir queue at the time of the switch would be processed no faster than 1 message every 40 seconds, and sometimes slower.

  Spam complaints (which always use a Maildir queue), would never be processed faster than 1 spam complaint every 40 seconds.

GreenArrow Engine v4.1.154

Bug Fixes

• Fix a bug in hvmail_migrate that would cause sending services to stop during a preview.

• Fix a bug in hvmail_init where warnings would sometimes be reported incorrectly.

• Fix critical bug in savedqueue restore introduced v4.1.148.

  The symptom is that the ram or bounce queue will not start if it was stopped with non-multiqueue messages in it.

  The following is logged to /var/hvmail/log/ram-qmail-send or /var/hvmail/log/bounce-qmail-send:

      qmail-savedqueue-restore: unable to requeue message (savedqueue/saved.1484727728.937421649.28750/mess/0/16698) (rv=94)
  

  And hvmail_init says the ok file is missing.

GreenArrow Engine v4.1.153

New Features & Improvements

• Miscellaneous performance enhancements to the bounce processor, including using Redis to allow for performing more bounce processing in RAM, and adding support for multi-threaded bounce processing.
• Update bounce processor to support Type-8 and Type-9 bounces and spam complaints. These are generated by GreenArrow Studio to provide a localpart that is <= 64 characters in length.
• Replace the libopendkim package dependency with a built-in copy of libopendkim.

GreenArrow Engine v4.1.148

New Features & Improvements

• Add option to reduce Apache’s memory usage.
• Add support for a new Return-Path format used by Studio. The new format reduces the Return-Path length.
• Add empty alt text to the SimpleMH open tracking image.
• Add beta support for greenarrow-remote, a feature which reduces the CPU and RAM requirements for SMTP deliveries.
• Make miscellaneous performance related improvements. Some are turned on by default. Others have feature flags which must be turned on in order for them to be enabled.
• Add support for new bounce codes.
• Add support for new hvmail_init invocations. See the output of hvmail_init --help.

Bug Fixes

• Fix a bug which caused hvmail_dd_logreader to waste CPU cycles.
• Fix a bug in repeatbounce processing for Studio remote lists.

GreenArrow Engine v4.1.147

New Features & Improvements

• Improve the GreenArrow update process. It’s now more automated.

GreenArrow Engine v4.1.146

New Features & Improvements

• GreenArrow now uses PostgreSQL 9.5 by default for new installs
• Improve unmanaged backup script. Improvements include adding documentation on how to handle more edge cases, better error handling and adding support for backing up and restoring to PostgreSQL 9.5
• Add new hard bounce code to bounce processor

Bug Fixes

• Update hvmail_check_config script to correctly report on the inode count

GreenArrow Engine v4.1.144

New Features & Improvements

• Add documentation on restoring from backups
• Improve unmanaged backup script. Improvements include better error detection and the creation of files that are faster to restore from than they were previously.
• Add an Event Notification System Configuration document

GreenArrow Engine v4.1.142

New Features & Improvements

• Update unmanaged backup script to allow for slightly smaller backups and faster restores. The previous version worked. These are improvements only.

Bug Fixes

• Add security codes to SimpleMH click, open and unsubscribe tracking links to mitigate the risk of certain types of attacks.

  By default, GreenArrow will continue to process links that were sent out prior to this update for up to 90 days after they were sent out before marking them as expired. To overwrite this setting, update the /var/hvmail/control/opt.simplemh_allow_insecure_links_for_days file. For example, to set this value to 365 days, run:

    echo 365 > /var/hvmail/control/opt.simplemh_allow_insecure_links_for_days
  

  This setting can be adjusted at any time.

  This expiration setting does not apply to links sent out after this update is applied. It also does not apply to any Studio links.

GreenArrow Engine v4.1.141

New Features & Improvements

• Improve SimpleMH’s automatic seeding performance.
• Enable GreenArrow’s spam complaint processor to parse X-Mailer-Info headers whose case was changed in a spam complaint.
• Add throttle template rules for cs.com, optimum.net, optonline.net, and cox.net. These will only be added to new installs by default.
• Process ARF spam complaints that are delivered to a bounce processing mailbox. Amazon SES sends these.
• Update the output of service greenarrow status to be more user-friendly.
• Add information about the license key status and status of individual services to the output of hvmail_init status.
• Refuse to start email sending services, but allow remaining services to try to start if SELinux is enabled. SELinux should be disabled on GreenArrow installations.
• Log a useful error message if GreenArrow’s email sending services refuse to start.

Bug Fixes

• Fix a SimpleMH bug which would cause a bounce processing error if a CCed email address bounced.
• Fix a bug which prevented GreenArrow from killing rogue services during startup.
• Fix a bug which could cause a new instance of svscanboot to be launched each time service greenarrow status is run.

GreenArrow Engine v4.1.138

Bug Fixes

• Restore DKIM signing using the Sender header domain when using SimpleMH.

GreenArrow Engine v4.1.136

New Features & Improvements

• Update the Event Notification System’s table’s primary key to be a bigint instead of an int. This increases the limit on the number of Event Notification System events from 2^31 (2 billion) to 2^55 (90 septendecillion) rows (https://www.postgresql.org/docs/9.4/static/datatype-numeric.html).

GreenArrow Engine v4.1.135

New Features & Improvements

• Update the stats API to generate an error instead of an HTTP 500 response for some types of invalid API calls.

GreenArrow Engine v4.1.134

New Features & Improvements

• Add the hvmail_migrate script, which can be used to automate database migrations and other tasks that are performed following package upgrades. This script is currently in beta.

GreenArrow Engine v4.1.133

New Features & Improvements

• Create new PostgreSQL indexes to improve the performance of the configuration API and web interfaces on systems with a large number of IP addresses.

Bug Fixes

• Update bounce processor to correctly classify a specific type of Other bounce which was previously classified as a Hard bounce under certain circumstances
• Improve security of the configuration API, and configuration web interface.

GreenArrow Engine v4.1.132

New Features & Improvements

Secure new Engine API at /ga/api/v3/eng in Apache.

Add documentation for new Engine API

Bug Fixes

Fix SimpleMH bug which could lead to flock timeouts

GreenArrow Engine v4.1.131

New Features & Improvements

• Add query_limit and concurrency options to the event processor.

GreenArrow Engine v4.1.129

Bug Fixes

• Update SimpleMH’s Bad Address Suppression database as the hvqmaild user. This change was made because systems that use restrictive umasks could have prevented the hvqmaild user from reading the file. That, in turn, would have prevented Engine’s HTTP Submission API from using Bad Address Suppression. Most systems were not impacted by this issue.

GreenArrow Engine v4.1.128

New Features & Improvements

• Update bounce processor to more accurately classify AOL bounces and deferrals.

GreenArrow Engine v4.1.127

New Features & Improvements

• Add the Dynamic Delivery system.
• Update /var/hvmail/control/httpd.ssl.listen to support setting Apache’s SSLCertificateChainFile parameter on a per-VirtualHost basis.

GreenArrow Engine v4.1.125

New Features & Improvements

• Add suport for the /var/hvmail/control/redis.conf and /var/hvmail/control/httpd.ssl.custom.conf Redis configuration files.
• Add suport for the /var/hvmail/control/httpd.ssl.custom.conf configuration file for Apache’s HTTPS configuration

GreenArrow Engine v4.1.124

Bug Fixes

• Fix a bug which would cause new installations to incorrectly report an error creating the schema in PostgreSQL.

New Features & Improvements

• Add suport for the /var/hvmail/control/opt.passenger.disabled configuration file, which disables Passenger when set equal to 1.

GreenArrow Engine v4.1.123

New Features & Improvements

• Add the /var/hvmail/control/dkim/hashfunc configuration file. This file is used to select the cryptographic hash function used in DKIM signatures. Valid options are sha1 (the default) and sha256. This works for both SimpleMH and Raw Injection.

Bug Fixes

• Fix a bug which sometimes causes the POP3 server to refuse login attempts due to memory allocation failures.

GreenArrow Engine v4.1.122

New Features & Improvements

The SimpleMH Click Tracking ID (supplied in the X-GreenArrow-Click-Tracking-ID header) is now included in the following places:

• The Delivery Event Processed Logfile (hvmail_report --processed-logfile).
• The “View result for each message” report linked from the “SMTP Server Stats” tab of the Send Statistics Page, unless the report is accessed from a Campaign Stats Embeddable HTML report with api=embed_html.
• The Campaign Recipient Status API.

GreenArrow Engine v4.1.121

New Features & Improvements

• Improve SimpleMH performance by writing messages directly to the ram-queue and performing DKIM signing internally.
• Remove support for the X-GreenArrow-Signing-Key-Filename and X-GreenArrow-DomainKeys-Enable headers in SimpleMH, and deprecate them in Raw Injection.
• Remove feature that reads DKIM keys from /var/hvmail/control/domainkeys.legacy. This was an old compatibility method.
• SimpleMH now listens on the /var/hvmail/var/simplemh.sock Unix socket instead of TCP port 627. The path to this Unix socket may change in the future, and so should not be relied upon.

Contact GreenArrow technical support if you would like any of the items removed by this release to be re-enabled.

GreenArrow Engine v4.1.120

New Features & Improvements

• Add hvmail_hw_specs script for generating hardware spec reports.
• Add hvmail_send_monitor_test script for performing GreenArrow Monitor tests.

GreenArrow Engine v4.1.119

New Features & Improvements

• Add Redis-hiredis Perl module to improve Redis performance.

GreenArrow Engine v4.1.118

Bug Fixes

• Fix a bug in hvmail_monitor_seeds script.
• Fix a bug introduced in version 4.1.112 that prevents Routing Rules with a domain or default entry that has more than two VirtualMTAs from being saved.

GreenArrow Engine v4.1.117

New Features & Improvements

• Increase SimpleMH’s timeout for a lock on /var/hvmail/var/clickthrough-tracking-emaillist/ files from to 2 to 10 seconds.
• Add the X-GreenArrow-BounceMailboxOverride header to SimpleMH. This allows for specifying a bounce mailbox that will override both the $RETURN_PATH_OVERRIDE variable in /var/hvmail/control/simplemh-config and any Override default bounce address setting in the Mail Class.

Bug Fixes

• Update SimpleMH so that a failure processing a message causes a temporary error to be returned to the sender. Previously the message would be passed through unmodified.

GreenArrow Engine v4.1.108

New Features & Improvements

• Don’t allow Apache to execute PHP files uploaded with Studio. There were already safe guards in place on the Studio side. This adds an extra layer of protection.

GreenArrow Engine 4.1.107-1

New Features & Improvements

• Add http_keep_alive option to event_processor.conf.
• Add runtime dependency of libopendkim.

Bug Fixes

• Fixed call to JSON::PP in event processor.

GreenArrow Engine v4.1.106

New Features & Improvements

• Add IO::Epoll perl module
• Performance improvements to rspawn-limiter
• Add optional statically compiled qmail-remote binary

GreenArrow Engine 4.1.105-1

New Features & Improvements

• Update OpenSSL to 1.0.2e

Bug Fixes

GreenArrow Engine v4.1.104

New Features & Improvements

• Add Error and Mail::OpenDKIM Perl modules (used by Studio).
• Renamed the event_processor service to hvmail_event_processor. This is now configured with a JSON configuration file. See documentation for more information.

GreenArrow Engine v4.1.103

New Features & Improvements

• Change bounce message 550 Requested action not taken: mailbox unavailable to be a hard bounce, code 10, Bad e-mail address.

GreenArrow Engine 4.1.102-1

New Features & Improvements

• Improve click and open tracking scalability.

GreenArrow Engine 4.1.101-2

Bug Fixes

• Add bpg-sans-fonts package dependency for CentOS 6 and 7 packages to fix a dynamic delivery graphing issue.
• Make /var/hvmail/apache/htdocs/index.html a configuration file. This means that customizations made to this file will not be overwritten by future updates.

GreenArrow Engine 4.1.101-0

New Features & Improvements

• Exclude local deliveries from Dynamic Delivery graphs.
• Speed up Dynamic Delivery log processing when behind.

Bug Fixes

• When there is an exception on processing a bounce or spam complaint message, move that message to an archive instead of automatically trying to process it again later.

GreenArrow Engine v4.1.100

New Features & Improvements

• Add new AOL bounce code to bounce processor.

Bug Fixes

• Fix a bug which causes the default throttling rule for an IP address to lose its settings during a VirtualMTA renaming.

GreenArrow Engine v4.1.99

New Features & Improvements

Add local user database for authenticating SMTP deliveries and API deliveries. Documentation of SMTP AUTH. This feature is enabled with the /var/hvmail/control/opt.smtp_auth_user_database control file.

GreenArrow Engine 4.1.98-1

Bug Fixes

• Fix Redis configuration bug.

GreenArrow Engine 4.1.98-0

Bug Fixes

• Fix a bug in event_processor service which would sometimes cause errors when the $HANDLER_BY_EVENT_TYPE variable wasn’t defined.
• Fix out of order variables bug in event_processor.conf configuration file.

GreenArrow Engine v4.1.97

New Features & Improvements

• Add unmanaged backup script to /var/hvmail/bin/hvmail_unmanged_backup.
• Update regex for detecting valid Mail Class names to accept underscore (_) characters.
• Add script to /var/hvmail/bin/hvmail_relay_forwarding for use as a dot-qmail delivery rule. Type hvmail_relay_forwarding help for more information.
• Add script to /var/hvmail/bin/hvmail_monitor_seeds that will retrieve the GreenArrow Monitor seed list to either SimpleMH or Studio.