cancel
Showing results for 
Search instead for 
Did you mean: 

Have spam filters been trained over XMAS?

jelv
Seasoned Hero
Posts: 26,785
Thanks: 971
Fixes: 10
Registered: ‎10-04-2007

Have spam filters been trained over XMAS?

In all the forums and on Usenet many, many people are complaining about the increasing volume of spam getting through without the [-SPAM-] tagging. Plusnet have encouraged people to keep reporting it and I've seen plenty of people saying they have been doing just that. But it doesn't seem to be getting any better.
I know that feeding the reported Spam and Ham is a manual process.
Has this been done on a a daily basis over the holiday period. If so how many training emails have been fed to the system?
I suspect that because a full roll-out of Postini is imminent they have abandoned training the current DSPAM filters - meaning that anyone reporting spam is wasting their time.
jelv (a.k.a Spoon Whittler)
   Why I have left Plusnet (warning: long post!)   
Broadband: Andrews & Arnold Home::1 (FTTC 80/20)
Line rental: Pulse 8 Home Line Rental (£14.40/month)
Mobile: iD mobile (£4/month)
94 REPLIES 94
ChemicalBrother
Grafter
Posts: 1,887
Thanks: 5
Registered: ‎05-04-2007

Re: Have spam filters been trained over XMAS?

I have to side with Jelv on this one - I have noticed a marked increase of spam particularly to my postmaster account, and worryingly, I have found legitimate emails that have been previously marked and sent as not spam are still being sent to the spam folder marked with the [SPAM] tag.
This would lead to the assumption that DSPAM hasn't been trained in lieu of other projects that are ongoing.
pwebb
Grafter
Posts: 65
Registered: ‎05-04-2007

Re: Have spam filters been trained over XMAS?

Quote from: rogerloxton
This would lead to the assumption that DSPAM hasn't been trained in lieu of other projects that are ongoing.

I have just checked and it was trained on the 24th and will be trained again today.
The reason for this is not due to Postini or any other projects, but simply due to the reduced staffing levels over the Christmas period.
Phil
jelv
Seasoned Hero
Posts: 26,785
Thanks: 971
Fixes: 10
Registered: ‎10-04-2007

Re: Have spam filters been trained over XMAS?

In that case I would suggest that you let the staffing level drop too low!
Have you seen some of the posts about this? You could be losing users as a result - here's a sample from Usenet:
Quote
I can't believe that PlusNet is actually doing anything to stop the spam!
35 virtually identical items in my in-boxes this morning, since gone midnight last night, and presumably the same number in my wife's when she next uses her computer. (and one real message)
I would have thought it was in PlusNet's (and other ISPs) to stop it as it must be costing them a fortune.
Meanwhile my wife wants to know why I don't change my ISP "what if the (grand) children see it?"
Sorry, but its only the hassle involved which is stopping me changing at the moment - but if changing becomes less than the hassle of the spam, then I'm off

If you haven't realised, a lot of people have got very, very upset about the level of spams in the last two or three weeks. Knowing that the reason their efforts in forwarding missed spam hasn't been improving the perceived detection rate is because you haven't been doing any training is not going to improve matters.
Having Postini on the horizon is no answer for people who have faced 80-90% spam as compared to real emails all over the holiday.
You have dropped a spherical object on this - big time!
jelv (a.k.a Spoon Whittler)
   Why I have left Plusnet (warning: long post!)   
Broadband: Andrews & Arnold Home::1 (FTTC 80/20)
Line rental: Pulse 8 Home Line Rental (£14.40/month)
Mobile: iD mobile (£4/month)
pwebb
Grafter
Posts: 65
Registered: ‎05-04-2007

Re: Have spam filters been trained over XMAS?

Quote from: jelv
In that case I would suggest that you let the staffing level drop too low!

It was last trained the day before Christmas. It was not done on Thursday and Friday last week and was being done today, so it's only not been done on 2 working days.
Quote from: jelv
If you haven't realised, a lot of people have got very, very upset about the level of spams in the last two or three weeks.

It was last trained 7 days ago, so I'm not sure why there would have been anything other than the usual seasonal increase that has caused the issue. This is also one of the main reasons that we have gone for a commercial offering as it will be far better than our own dspam solution.
Quote from: jelv
Having Postini on the horizon is no answer for people who have faced 80-90% spam as compared to real emails all over the holiday.
You have dropped a spherical object on this - big time!

I'm not sure why Postini is relevant to this conversation as we have not done anything different with our spam systems than we usually would?
Phil
jelv
Seasoned Hero
Posts: 26,785
Thanks: 971
Fixes: 10
Registered: ‎10-04-2007

Re: Have spam filters been trained over XMAS?

Quote from: pwebb
Quote from: jelv
In that case I would suggest that you let the staffing level drop too low!

It was last trained the day before Christmas. It was not done on Thursday and Friday last week and was being done today, so it's only not been done on 2 working days.

Could you inform the spammers that they should not send out spam on weekends and bank holidays please! Wink
We were told some time back that training the spam filters was a daily activity - with no suggestion that it was weekdays only. As spammers operate 24x7, and you process mail 24x7 training the spam filters should be a daily task.
Quote from: pwebb
Quote from: jelv
If you haven't realised, a lot of people have got very, very upset about the level of spams in the last two or three weeks.

It was last trained 7 days ago, so I'm not sure why there would have been anything other than the usual seasonal increase that has caused the issue. This is also one of the main reasons that we have gone for a commercial offering as it will be far better than our own dspam solution.

The spammers have changed tack slightly many now have multiple words run together in both the subject and body; as you haven't been training the filter the vast majority of this has been getting through.
Quote from: pwebb
Quote from: jelv
Having Postini on the horizon is no answer for people who have faced 80-90% spam as compared to real emails all over the holiday.
You have dropped a spherical object on this - big time!

I'm not sure why Postini is relevant to this conversation as we have not done anything different with our spam systems than we usually would?

Bob would normally be keeping an eye on issues like increasing levels of spam getting through. It's obvious that he has been spending time on Postini. There were many indications that for people not on the Postini trial it was starting to go pear shaped the week before Xmas - there has been a total lack of action on a developing situation.
I would also point out that as the [-SPAM-] tagging for Postini trialists is still DSPAM, many of those will have a very jaundiced view of Postini because they are seeing far, far more spam getting through untagged than they were before they were moved on to the trial - I've seen a number of posts saying just that.
jelv (a.k.a Spoon Whittler)
   Why I have left Plusnet (warning: long post!)   
Broadband: Andrews & Arnold Home::1 (FTTC 80/20)
Line rental: Pulse 8 Home Line Rental (£14.40/month)
Mobile: iD mobile (£4/month)
elton
Grafter
Posts: 175
Registered: ‎30-07-2007

Re: Have spam filters been trained over XMAS?

For years I got NO spam. But since PlusNet allowed hackers into the mail server or whatever it was, I get an unmanagable deluge of (apparantly) pornographic spam. I bounce it all back using MailWasher (without ever actually downloading it), but it's rapidly becoming impractical due to the volume.
Is it likely that PlusNet's mail servers will at some point become completely overwhelmed by spam? Perhaps they'll do something practical about it then.
revdaveb
Newbie
Posts: 3
Registered: ‎31-12-2007

Re: Have spam filters been trained over XMAS?

There is a song with the line 'will you be lonely this christmas' ... well I certainly havent been, I get loadsa emails, on average 5-600 a day! Of which perhaps 1 or 2 are real and not a single one said [-SPAM-]
jelv
Seasoned Hero
Posts: 26,785
Thanks: 971
Fixes: 10
Registered: ‎10-04-2007

Re: Have spam filters been trained over XMAS?

Quote from: elton
I bounce it all back using MailWasher

Bouncing is the worst feature of MailWasher - 99% of spam has faked sender addresses. All you are doing is sending it back to some poor unfortunate who had nothing to do with it in the first place.
jelv (a.k.a Spoon Whittler)
   Why I have left Plusnet (warning: long post!)   
Broadband: Andrews & Arnold Home::1 (FTTC 80/20)
Line rental: Pulse 8 Home Line Rental (£14.40/month)
Mobile: iD mobile (£4/month)
Mav
Moderator
Moderator
Posts: 22,397
Thanks: 4,736
Fixes: 515
Registered: ‎06-04-2007

Re: Have spam filters been trained over XMAS?

Quote from: revdaveb
There is a song with the line 'will you be lonely this christmas' ... well I certainly havent been, I get loadsa emails, on average 5-600 a day!

I must be well loved; around 2 to 3K a day at times!
Maybe 1 or 2 real and planty not listed as [-SPAM-]

Forum Moderator and Customer
Courage is resistance to fear, mastery of fear, not absence of fear - Mark Twain
He who feared he would not succeed sat still

iashton
Grafter
Posts: 62
Registered: ‎30-07-2007

Re: Have spam filters been trained over XMAS?

Given the bad feeling generated by not running the spam filters as normal over the holiday season I assume Postini will operate 24*7?
Or can PlusNet start drawing up holiday schedules now to make sure it does?
And how long before Postini gets here for the rest of us anyway? Real dates would be appreciated.

Ianwild
Grafter
Posts: 3,835
Registered: ‎05-04-2007

Re: Have spam filters been trained over XMAS?

Why not sign up for the trial if you want it sooner?
We will of course be increasing Postini's reach over the next couple of weeks and will move as quickly as possible on to the full implementation. A lot depends on the outcome and changes needed as a result of the trial as to when we implement the next stages. There aren't any dates we've agreed to internally yet - I would be happy to share them if there were.
Bear in mind that the main advantage of Postini is that they handle more email than all the other Anti-spam providers combined. As such most spam attacks are spotted and blocked within a very short space of time. They don't rely on individuals reporting spam and then manual checking to qualify each piece before applying the training (A major flaw in Dspam!). Postini have the scale to make a system that works, whereas with Dspam their just isn't - with our implementation there was always the flaws which are so very present now.
I'm pretty sure, even after today's training, it's still not going to be hugely better on the spam detection front. I think that would be the case even if all you folks all came to Sheffield and sat with us inputting the spam. The system is simply not good enough to the do what we are asking from it, and that is why until it is replaced there is no real hope of this problem going away.
Ian
Oldjim
Resting Legend
Posts: 38,460
Thanks: 787
Fixes: 63
Registered: ‎15-06-2007

Re: Have spam filters been trained over XMAS?

The Postini trial  appears to have very little effect on the amount of Spam received except for cutting out the direct MX route and this won't change until PlusNet use the Postini report to put the spam into the spam folder like DSPAM does.
iashton
Grafter
Posts: 62
Registered: ‎30-07-2007

Re: Have spam filters been trained over XMAS?

Quote
I'm pretty sure, even after today's training, it's still not going to be hugely better on the spam detection front. I think that would be the case even if all you folks all came to Sheffield and sat with us inputting the spam. The system is simply not good enough to the do what we are asking from it, and that is why until it is replaced there is no real hope of this problem going away.

Well for it to work as well as it can you still have to run it. If you'd have asked for volunteers to run it over the holiday period I'd have helped out - assuming I could have a remote login.
jelv
Seasoned Hero
Posts: 26,785
Thanks: 971
Fixes: 10
Registered: ‎10-04-2007

Re: Have spam filters been trained over XMAS?

Quote from: Oldjim
The Postini trial  appears to have very little effect on the amount of Spam received except for cutting out the direct MX route and this won't change until PlusNet use the Postini report to put the spam into the spam folder like DSPAM does.

Jim, have you seen a doubling or more of the volume of spam received since you sent on the trial? That is the amount of increase MikeB is reporting here and many, many others also not on Postini are reporting dramatic increases. If you are not seeing that sort of increase just imagine how many spams you would be getting if you were not on Postini!
jelv (a.k.a Spoon Whittler)
   Why I have left Plusnet (warning: long post!)   
Broadband: Andrews & Arnold Home::1 (FTTC 80/20)
Line rental: Pulse 8 Home Line Rental (£14.40/month)
Mobile: iD mobile (£4/month)