Mass Mailing Count Malfunction

 
From: "Bruce Harper bharper@PROTECTED [Dada Mail Developers]" <dadadev@PROTECTED>
Date: May 19th 2016
Every so often one of our scheduled mass mailings gets hung and needs to be restarted. The error that shows up is

Warning: $mass_mailing_count: 4286 is not the same as  $new_count: 4298

Typically the count is off by 1 with today's large disparity a bit unusual. Pausing then restarting the mailing gets things back on track, but it the problem crops up early in the send out it may not be discovered for a couple of hours, which delays sending of a time-sensitive message.

Listed below are the various lines from the log files from around the time the problem started. There was nothing unusual in the system.log at the time of the problem.

Question is, why might the count get out of whack and is there a way to prevent it?

Bruce in Blacksburg
Virginia Tech Webmaster

---------
sendout-vtfsnews1-list-20160519011605.09668203_at_vt.edu-log.txt

[Thu May 19 06:18:10 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4282
[Thu May 19 06:20:10 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4283
[Thu May 19 06:22:10 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4284
[Thu May 19 06:24:10 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4285
[Thu May 19 06:25:12 2016]      mass mailing is reporting that it should be restarted from PID:33972
[Thu May 19 06:25:12 2016]      Mass Mailing Starting: Message-Id: 20160519011605.09668203_at_vt.edu    Subject: Message      Started: Thu May 19 01:16:20 2016       Mailing Amount: 4962
[Thu May 19 06:25:12 2016]      Queueing is enabled.
[Thu May 19 06:25:12 2016]      $status->{queue_place} 0
[Thu May 19 06:25:12 2016]      This message is below the mass mailing limit and shouldn't have delays in sending.
[Thu May 19 06:25:12 2016]      $status->{percent_done} is reporting 86
[Thu May 19 06:25:12 2016]      About to fork off mass mailing...
[Thu May 19 06:25:12 2016]      Mass Mailing Starting.
[Thu May 19 06:25:12 2016]      opened MAILLIST
[Thu May 19 06:25:13 2016]      Batching Enabled: 1, Batch Size: 100, Batch Sleep: 2
[Thu May 19 06:25:31 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4286
[Thu May 19 06:25:34 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4287
[Thu May 19 06:25:37 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4288
[Thu May 19 06:25:41 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4289
[Thu May 19 06:25:44 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4290
[Thu May 19 06:25:48 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4291
[Thu May 19 06:25:51 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4292
[Thu May 19 06:25:54 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4293
[Thu May 19 06:25:58 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4294
[Thu May 19 06:26:01 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4295
[Thu May 19 06:26:04 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4296
[Thu May 19 06:26:08 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4297
[Thu May 19 06:26:10 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4298
[Thu May 19 06:26:10 2016]      [vtfsnews1] Mass Mailing:<20160519011605.09668203@PROTECTED> Warning: $mass_mailing_count: 4286 is not the same as  $new_count: 4298
[Thu May 19 06:26:11 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4299
[Thu May 19 06:26:11 2016]      [vtfsnews1] Mass Mailing:20160519011605.09668203_at_vt.edu Warning: $mass_mailing_count: 4298 is not the same as  $new_count: 4299
[Thu May 19 07:56:19 2016]      mass mailing is reporting that it should be restarted from PID:39078
[Thu May 19 07:56:19 2016]      Mass Mailing Starting: Message-Id: 20160519011605.09668203_at_vt.edu    Subject: Message      Started: Thu May 19 01:16:20 2016       Mailing Amount: 4962
[Thu May 19 07:56:19 2016]      Queueing is enabled.
[Thu May 19 07:56:19 2016]      $status->{queue_place} 0
[Thu May 19 07:56:19 2016]      This message is below the mass mailing limit and shouldn't have delays in sending.
[Thu May 19 07:56:19 2016]      $status->{percent_done} is reporting 86
[Thu May 19 07:56:19 2016]      About to fork off mass mailing...
[Thu May 19 07:56:19 2016]      Mass Mailing Starting.
[Thu May 19 07:56:19 2016]      opened MAILLIST
[Thu May 19 07:56:19 2016]      Batching Enabled: 1, Batch Size: 100, Batch Sleep: 2
[Thu May 19 07:56:37 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4300
[Thu May 19 07:56:41 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4301
[Thu May 19 07:56:44 2016]      "Virginia Tech News Daily Email Subscriber" <@vt.edu> sent message #4302

errors.txt

[Thu May 19 06:25:10 2016] mail.cgi: problems sending FROM:<> command to SMTP server. at DADA/App/MassSend.pm line 409.
[Thu May 19 06:25:10 2016] mail.cgi: problems sending FROM:<> command to SMTP server. at DADA/App/MassSend.pm line 409.
[Thu May 19 06:25:12 2016] mail.cgi: restart_with set to: 20160519011605.09668203_at_vt.edu at DADA/Mail/Send.pm line 1086.
[Thu May 19 06:25:12 2016] mail.cgi: Reloading message... (33972) at DADA/Mail/MailOut.pm line 1822.
[Thu May 19 06:25:14 2016] mail.cgi: returning message id<20160519011605.09668203@PROTECTED> at DADA/Mail/MailOut.pm line 2645.
[Thu May 19 06:26:10 2016] mail.cgi: problems sending, "RSET" command to SMTP server. at DADA/App/MassSend.pm line 409.
[Thu May 19 06:26:10 2016] mail.cgi: [vtfsnews1] Mass Mailing:<20160519011605.09668203@PROTECTED> Warning: $mass_mailing_count: 4286 is not the same as  $new_count: 4298 at DADA/App/MassSend.pm line 409.
[Thu May 19 06:26:11 2016] mail.cgi: [vtfsnews1] Mass Mailing:20160519011605.09668203_at_vt.edu Warning: $mass_mailing_count: 4298 is not the same as  $new_count: 4299 at DADA/Mail/MailOut.pm line 2645.
   <snip>
[Thu May 19 07:56:19 2016] mail.cgi: restart_with set to: 20160519011605.09668203_at_vt.edu at DADA/Mail/Send.pm line 1086.
[Thu May 19 07:56:19 2016] mail.cgi: Reloading message... (39078) at DADA/Mail/MailOut.pm line 1822.
[Thu May 19 07:56:20 2016] mail.cgi: returning message id<20160519011605.09668203@PROTECTED> at DADA/Mail/MailOut.pm line 2645.

dada.txt

[Thu May 19 06:24:56 2016]      vtnewsHTML      00.000.000.0    login   remote_host:, ip_address:00.000.000.0
[Thu May 19 06:25:12 2016]      vtfsnews1       00.000.000.0    Restarting List Sending Internal ID: 20160519011605.09668203_at_vt.edu
[Thu May 19 06:25:12 2016]      vtfsnews1       00.000.000.0    Mass Mailing Starting   Message-Id: 20160519011605.09668203_at_vt.edu   Subject: Message      Started: Thu May 19 01:16:20 2016       Mailing Amount: 4962

[Thu May 19 07:56:12 2016]      vtnewsHTML      00.000.000.0    login   remote_host:, ip_address:00.000.000.0
[Thu May 19 07:56:19 2016]      vtfsnews1       00.000.000.0    Restarting List Sending Internal ID: 20160519011605.09668203_at_vt.edu
[Thu May 19 07:56:19 2016]      vtfsnews1       00.000.000.0    Mass Mailing Starting   Message-Id: 20160519011605.09668203_at_vt.edu   Subject: Message      Started: Thu May 19 01:16:20 2016       Mailing Amount: 4962
[Thu May 19 08:35:44 2016]      vtfsnews1       00.000.000.0    Mass Mailing Completed  Message-Id: 20160519011605.09668203_at_vt.edu   Subject: Message      Started: Thu May 19 01:16:20 2016       Finished: Thu May 19 08:35:33 2016      Mailing Amount: 4962


  • This mailing list is a public mailing list - anyone may join or leave, at any time.
  • This mailing list is a group discussion list (unmoderated)
  • Start a new thread, email: dadadev@dadamailproject.com

This is the developer discussion mailing list for Dada Mail.

If you are just looking for support Dada Mail, consult the message boards at:

https://forum.dadamailproject.com

Documentation for Dada Mail:

https://dadamailproject.com/d

Specifically, see the Error FAQ:

https://dadamailproject.com/d/FAQ-errors.pod.html

To post to this list, send a message to:

mailto:dadadev@dadamailproject.com

All subscribers of this list may post to the list itself.

Topics that are welcome:

  • Constructive critiques on the program (I like, "x", but, "y" needs some work - here's an idea on how to make this better...)
  • Bug/Error reports
  • Bug fixes
  • Request For Comments on any changes to the program
  • Help customizing Dada Mail for your own needs
  • Patches
  • Language Translations
  • Support Documentation/Doc editing, FAQ's, etc.
  • Discussion of any changes that you would like to be committed to the next version of Dada Mail -

Dada Mail is on Github:

https://github.com/justingit/dada-mail/

If you would like to fork, branch, send over PRs, open up issues, etc.

Privacy Policy:

This Privacy Policy is for this mailing list, and this mailing list only.

Email addresses collection through this mailing list are used explicitly to work within this email discussion list.

We only collect email addresses through our Closed-Loop Opt-In system.

We don't use your email address for any other purpose.

We won't be sharing your email address with any other entity.

Unsubscription can be done at any time. Please contact us at: justin@dadamailproject.com for any help regarding your subscription, including removal from the mailing list.

All mailing list messages sent from us will include a subscription removal link, which will allow you to remove yourself from this mailing list automatically, and permanently.

All consent to use your email address for any other purpose stated at the time of the mailing list subscription will also be revoked upon mailing list removal.