ispCP - Board - Support
[Maia] DB läuft voll; Bayes_token über 30.000 Zeilen - Printable Version

+- ispCP - Board - Support (http://www.isp-control.net/forum)
+-- Forum: ispCP Omega International Area (/forum-22.html)
+--- Forum: German Corner (/forum-26.html)
+---- Forum: Plauderecke (/forum-49.html)
+---- Thread: [Maia] DB läuft voll; Bayes_token über 30.000 Zeilen (/thread-1561.html)

Pages: 1 2


[Maia] DB läuft voll; Bayes_token über 30.000 Zeilen - Kaimane - 10-18-2007 05:59 AM

Hallo Community!


Mittlerweile funktioniert Maia Mailguard mit SA, Amavis und Co. sehr stabil. Nur ist mir die Tage aufgefallen, dass die DB durch den Spamfilter ziemlich voll läuft.
Die DB-Tabelle 'Bayes_Token' beherrbergt aktuell über 30.000 Zeilen und belegt damit schon einige MB.

Ist das normal, oder bedarf es einen Cron, damit die DB regelmäßig gesäubert wird?

Vielen Dank!!
Kaimane


RE: [Maia] DB läuft voll; Bayes_token über 30.000 Zeilen - joximu - 10-18-2007 06:36 AM

Kannst du das im Maia-Forum, oder in einem Spamassasisn-Forum in Erfahrung bringen?


RE: [Maia] DB läuft voll; Bayes_token über 30.000 Zeilen - Kaimane - 10-18-2007 07:16 AM

Ja du hast recht, die Frage passt nicht ganz in dieses Forum.
Sobald ich aber eine Lösung gefunden habe, werd ich mich sicher noch mal melden Wink

Kaimane


RE: [Maia] DB läuft voll; Bayes_token über 30.000 Zeilen - joximu - 10-18-2007 07:23 AM

Cool - das wäre toll.

Danke :-)


RE: [Maia] DB läuft voll; Bayes_token über 30.000 Zeilen - BeNe - 10-18-2007 03:51 PM

Hast du denn die Wartungsscripte in deiner Cron drin ?
Ist Punkt 19. auf dem HowTo im Wiki.

Greez BeNe


RE: [Maia] DB läuft voll; Bayes_token über 30.000 Zeilen - Kaimane - 10-20-2007 12:09 AM

BeNe Wrote:Hast du denn die Wartungsscripte in deiner Cron drin ?
Ist Punkt 19. auf dem HowTo im Wiki.

Zu Maia Mailguard gibt es verschiedene HowTos.
Welches davon meinst du?! Smile

Wartungsscripte sind aber als Cron eingerichtet:
Code:
55 * * * * /var/lib/amavis/maia/scripts/process-quarantine.pl --learn --report
1 * * * * /var/lib/amavis/maia/scripts/stats-snapshot.pl
5 1 * * * /var/lib/amavis/maia/scripts/expire-quarantine-cache.pl
@weekly /var/lib/amavis/maia/scripts/send-quarantine-reminders.pl
#15 1 * * * /var/lib/amavis/maia/scripts/send-quarantine-digests.pl

Die Crons werden als User 'Amavis' ausgeführt.


RE: [Maia] DB läuft voll; Bayes_token über 30.000 Zeilen - BeNe - 10-20-2007 12:12 AM

Quote:Welches davon meinst du?!
Das hier im Wiki bei uns -> http://www.isp-control.net/ispcp/wiki/maia

Quote:Wartungsscripte sind aber als Cron eingerichtet:
Hast du die Scripte schon mal manuell ausgeführt ?
Gibt es Fehler aus ?

Greez BeNe


RE: [Maia] DB läuft voll; Bayes_token über 30.000 Zeilen - Kaimane - 10-20-2007 01:52 AM

Ja genau dieses Wiki!

Nein, die Scripte hab ich noch nicht manuell gestartet. Wie mache ich das als User 'amavis' manuell? Bin auf dem Server als 'root' angemeldet.

EDIT:

Habe versucht das Script process-quarantine.pl mit
Code:
sudo -u amavis /var/lib/amavis/maia/scripts/process-quarantine.pl --learn --report
zu starten. Folgender Fehler trat auf:
Code:
config: cannot write to /root/.spamassassin/user_prefs: Keine Berechtigung
config: failed to create default user preference file /root/.spamassassin/user_prefs
2007-10-19 17:58:45 Maia: [process-quarantine-sub] 0 spam items processed (0 learned, 0 reported)
config: cannot write to /root/.spamassassin/user_prefs: Keine Berechtigung
config: failed to create default user preference file /root/.spamassassin/user_prefs
2007-10-19 17:58:45 Maia: [process-quarantine-sub] 0 non-spam items processed (0 learned)
2007-10-19 17:58:45 Maia: [process-quarantine] Processing completed: 0 items processed in 0 runs.

Soll ich die Scripts besser als User 'root' ausführen lassen?


RE: [Maia] DB läuft voll; Bayes_token über 30.000 Zeilen - joximu - 10-20-2007 08:02 AM

Hallo

Wenn natürlich der Benutzer amavs ins /root-Verzeichnis schreiben soll, dann geht das schief. Ich denke aber, das liegt am sudo.

Versuche mal:
su -s /bin/bash - amavis

dann bist du als amavis angemeldet - egal welche Shell dem Benutzer zugewiesen wurde. Und dann:
/var/lib/amavis/maia/scripts/process-quarantine.pl --learn --report

Gruss Joxi


RE: [Maia] DB läuft voll; Bayes_token über 30.000 Zeilen - Kaimane - 10-20-2007 10:11 AM

Klasse, joxi ... Mit diesem Befehl klappts!

Hab direkt den Befehl
Code:
/var/lib/amavis/maia/scripts/process-quarantine.pl --learn --report
ausgeführt und passiert ist folgendes:
Code:
2007-10-20 01:59:21 Maia: [process-quarantine-sub] Learned mail item 1836 as spam and reported it
2007-10-20 01:59:24 Maia: [process-quarantine-sub] Learned mail item 1843 as spam and reported it
2007-10-20 01:59:32 Maia: [process-quarantine-sub] Learned mail item 1848 as spam and reported it
2007-10-20 01:59:38 Maia: [process-quarantine-sub] Learned mail item 1850 as spam and reported it
2007-10-20 01:59:40 Maia: [process-quarantine-sub] Learned mail item 1852 as spam and reported it
2007-10-20 01:59:44 Maia: [process-quarantine-sub] Learned mail item 1854 as spam and reported it
2007-10-20 01:59:47 Maia: [process-quarantine-sub] Learned mail item 1855 as spam and reported it
2007-10-20 01:59:50 Maia: [process-quarantine-sub] Learned mail item 1859 as spam and reported it
2007-10-20 01:59:54 Maia: [process-quarantine-sub] Learned mail item 1861 as spam and reported it
2007-10-20 01:59:57 Maia: [process-quarantine-sub] Learned mail item 1862 as spam and reported it
2007-10-20 02:00:01 Maia: [process-quarantine-sub] Learned mail item 1863 as spam and reported it
2007-10-20 02:00:03 Maia: [process-quarantine-sub] Learned mail item 1865 as spam and reported it
2007-10-20 02:00:06 Maia: [process-quarantine-sub] Learned mail item 1866 as spam and reported it
2007-10-20 02:00:10 Maia: [process-quarantine-sub] Learned mail item 1871 as spam and reported it
2007-10-20 02:00:12 Maia: [process-quarantine-sub] Learned mail item 1882 as spam and reported it
2007-10-20 02:00:16 Maia: [process-quarantine-sub] Learned mail item 1884 as spam and reported it
2007-10-20 02:00:19 Maia: [process-quarantine-sub] Learned mail item 1887 as spam and reported it
2007-10-20 02:00:24 Maia: [process-quarantine-sub] Learned mail item 1891 as spam and reported it
2007-10-20 02:00:28 Maia: [process-quarantine-sub] Learned mail item 1892 as spam and reported it
2007-10-20 02:00:31 Maia: [process-quarantine-sub] Learned mail item 1893 as spam and reported it
2007-10-20 02:00:31 Maia: [process-quarantine-sub] 20 spam items processed (20 learned, 20 reported)
2007-10-20 02:00:32 Maia: [process-quarantine-sub] Learned mail item 1889 as non-spam
2007-10-20 02:00:32 Maia: [process-quarantine-sub] 1 non-spam item processed (1 learned)
2007-10-20 02:00:37 Maia: [process-quarantine-sub] Learned mail item 1896 as spam and reported it
2007-10-20 02:00:40 Maia: [process-quarantine-sub] Learned mail item 1904 as spam and reported it
2007-10-20 02:00:43 Maia: [process-quarantine-sub] Learned mail item 1906 as spam and reported it
2007-10-20 02:00:46 Maia: [process-quarantine-sub] Learned mail item 1907 as spam and reported it
2007-10-20 02:00:53 Maia: [process-quarantine-sub] Learned mail item 1909 as spam and reported it
2007-10-20 02:00:57 Maia: [process-quarantine-sub] Learned mail item 1910 as spam and reported it
2007-10-20 02:01:02 Maia: [process-quarantine-sub] Learned mail item 1919 as spam and reported it
2007-10-20 02:01:05 Maia: [process-quarantine-sub] Learned mail item 1922 as spam and reported it
2007-10-20 02:01:11 Maia: [process-quarantine-sub] Learned mail item 1923 as spam and reported it
2007-10-20 02:01:14 Maia: [process-quarantine-sub] Learned mail item 1924 as spam and reported it
2007-10-20 02:01:18 Maia: [process-quarantine-sub] Learned mail item 1934 as spam and reported it
2007-10-20 02:01:18 Maia: [process-quarantine-sub] 11 spam items processed (11 learned, 11 reported)
2007-10-20 02:01:18 Maia: [process-quarantine-sub] 0 non-spam items processed (0 learned)
2007-10-20 02:01:20 Maia: [process-quarantine-sub] 0 spam items processed (0 learned, 0 reported)
2007-10-20 02:01:20 Maia: [process-quarantine-sub] 0 non-spam items processed (0 learned)
2007-10-20 02:01:20 Maia: [process-quarantine] Processing completed: 32 items processed in 2 runs.

Der nächste Befehl
Code:
/var/lib/amavis/maia/scripts/stats-snapshot.pl
gab diese Meldung aus:
Code:
2007-10-20 02:04:32 Maia: [stats-snapshot] Updating stats history table.

Die nächste Ausgabe betraf den Befehl
Code:
/var/lib/amavis/maia/scripts/expire-quarantine-cache.pl
Weiterhin ohne Fehler oder Warnungen:
Code:
2007-10-20 02:05:09 Maia: [expire-quarantine-cache] Expiring Suspected Spam items [S] older than 30 days
2007-10-20 02:05:09 Maia: [expire-quarantine-cache] Expiring Virus/Malware items [V] older than 30 days
2007-10-20 02:05:09 Maia: [expire-quarantine-cache] Expiring Invalid Mail Header items [B] older than 30 days
2007-10-20 02:05:09 Maia: [expire-quarantine-cache] Expiring Banned File Attachment items [F] older than 30 days
2007-10-20 02:05:09 Maia: [expire-quarantine-cache] Expiring Suspected Non-Spam items [H] older than 7 days
2007-10-20 02:05:09 Maia: [expire-quarantine-cache] Expiring Orphaned items (mail with no recipients) older than one hour
2007-10-20 02:05:09 Maia: [expire-quarantine-cache] Expiring Stray References (recipient references with no mail items)
2007-10-20 02:05:09 Maia: [expire-quarantine-cache] Expiring Tokens due to expire now
2007-10-20 02:05:09 Maia: [expire-quarantine-cache] 0 Suspected Spam items expired
2007-10-20 02:05:09 Maia: [expire-quarantine-cache] 0 Virus/Malware items expired
2007-10-20 02:05:09 Maia: [expire-quarantine-cache] 0 items with Invalid Mail Headers expired
2007-10-20 02:05:09 Maia: [expire-quarantine-cache] 0 items with Banned File Attachments expired
2007-10-20 02:05:09 Maia: [expire-quarantine-cache] 0 Suspected Non-Spam items expired
2007-10-20 02:05:09 Maia: [expire-quarantine-cache] Current Cache After Expiration:
2007-10-20 02:05:09 Maia: [expire-quarantine-cache] Suspected Spam items               : 63
2007-10-20 02:05:09 Maia: [expire-quarantine-cache] Virus/Malware items                : 0
2007-10-20 02:05:09 Maia: [expire-quarantine-cache] Items with Invalid Mail Headers    : 5
2007-10-20 02:05:09 Maia: [expire-quarantine-cache] Items with Banned File Attachments : 0
2007-10-20 02:05:09 Maia: [expire-quarantine-cache] Suspected Non-Spam items           : 45

Die letzten beiden Scripts brauch ich wohl nicht ausführen. Das eine Script ist für die Erinnerungs-Emails zuständig und das Andere ist von vorn herein ausgeklammert.

Was mich nun wundert: Vorhin waren es noch 67.000 Einträge in der Tabelle 'Bayes_Token'. Nachdem ich die drei Scripts hab durchlaufen lassen sind es 'nur' noch 60.000 ...
Frag mich nun, wie bekomme ich den Rest weg? :/