Current time: 11-16-2024, 12:01 PM Hello There, Guest! (LoginRegister)


Post Reply 
vhost monitoring
Author Message
fulltilt Offline
Member
***

Posts: 1,225
Joined: Apr 2007
Reputation: 5
Post: #51
RE: vhost monitoring
Jaa sieht ganz gut aus ...
Bei mir ist nach den Logs alles O.K. es werden aber keine .png Bildchen erzeugt ...

Was muss ich tun?
Könnte auch an meiner hosts config liegen ...


BeNe Wrote:Ich glaube ich habe es --> http://ispcpdemo.homeip.net/munin/locald...tml#Apache

Schau es Dir mal an Smile

Greez BeNe
10-18-2007 06:44 PM
Find all posts by this user Quote this message in a reply
fulltilt Offline
Member
***

Posts: 1,225
Joined: Apr 2007
Reputation: 5
Post: #52
RE: vhost monitoring
mein Post ist auch weg

BeNe Wrote:Ich glaube ich habe es --> http://ispcpdemo.homeip.net/munin/locald...tml#Apache

Schau es Dir mal an Smile

Greez BeNe
10-18-2007 06:46 PM
Find all posts by this user Quote this message in a reply
BeNe Offline
Moderator
*****
Moderators

Posts: 5,899
Joined: Jan 2007
Reputation: 68
Post: #53
RE: vhost monitoring
*damn* Es geht tatsächlich... [Image: a040.gif]

Ja, jetzt muss ich noch versuchen herauszufinden was ich genau wo geändert habe.
Ich schreibe nochmals alles zusammen und poste es dann hier!

Greez BeNe
10-18-2007 06:50 PM
Visit this user's website Find all posts by this user Quote this message in a reply
BeNe Offline
Moderator
*****
Moderators

Posts: 5,899
Joined: Jan 2007
Reputation: 68
Post: #54
RE: vhost monitoring
Ich will das jetzt nochmals alles zusammen fassen.
Wenn es läuft werde ich es ins Wiki übernehmen.

Pakete besorgen / Module aktivieren / Apache2 neustarten
Code:
apt-get install apache2-dev libcrypt-ssleay-perl libwww-perl
a2enmod info
a2enmod status
/etc/init.d/apache2 force-reload

mod_watch besorgen / entpacken / bauen
Code:
wget http://forums.cacti.net/download.php?id=8888
mv download.php\?id\=8888 mod_watch-4.3_apache22_mod.tar.gz
tar -xvzf mod_watch-4.3_apache22_mod.tar.gz
cd mod_watch-4.3_apache22_mod
vi Makefile.dso
Den Inhalt für Debian Etch so anpassen
Code:
# The location of apxs utility.
#
#APXS=/home/apache2/bin/apxs
APXS=/usr/bin/apxs2

#
# The location of apachectl utility to stop/start/restart targets.
#
APACHECTL=apache2ctl

#
# Where the scripts should live
#
SCRIPTDIR=/usr/local/sbin

#
# Where to store the weenie files.
#
STATEDIR=/usr/lib/apache2/modules/mod_watch/
modul bauen
Code:
make -f Makefile.dso build
make -f Makefile.dso install
Module in Apache laden
Code:
vi /etc/apache2/httpd.conf
und das hier einfügen
Code:
LoadModule watch_module /usr/lib/apache2/modules/mod_watch.so

Apache config anpassen, der erste Teil sollte schon so drin stehen weil die module vorher eingebunden wurden, wenn nicht dann bitte einfügen
Code:
<IfModule mod_status.c>

     #Allow server status reports generated by mod_status,
     #with the URL of http://servername/server-status
     #Change the ".example.com" to match your domain to enable.

    <Location /server-status>
        SetHandler server-status
        Order deny,allow
        Deny from all
        Allow from 127.0.0.1
    </Location>
</IfModule>

<IfModule mod_info.c>

     #Allow remote server configuration reports, with the URL of
     # http://servername/server-info (requires that mod_info.c be loaded).
     #Change the ".example.com" to match your domain to enable.

    <Location /server-info>
        SetHandler server-info
        Order deny,allow
        Deny from all
        Allow from 127.0.0.1
    </Location>
</IfModule>
und das hier (auch) noch hinzufügen:
Code:
<IfModule mod_watch.c>
    # Allows the URL used to query virtual host data:
    #
    # http://www.snert.com/watch-info
    #
    <Location /watch-info>
    SetHandler watch-info
    Order allow,deny
    Allow from 127.0.0.1
    </Location>


    # Intended for debugging and analysis of shared memory
    # hash table and weenie files:
    #
    #http://127.0.0.1/watch-table
    #

    <Location /watch-table>
    SetHandler watch-table
    Order allow,deny
    Allow from 127.0.0.1
    </Location>

    <Location /watch-list>
    SetHandler watch-list
    Order allow,deny
    Allow from 127.0.0.1
    </Location>
</IfModule>
apache neustarten / mod_watch.c kopieren
Code:
/etc/init.d/apache2 restart
cd /root/mod_watch-4.3_apache22_mod
cp mod_watch.c /usr/share/munin/plugins/
chmod 777 /usr/share/munin/plugins/mod_watch.c
apache_watch_ erstellen
Code:
vi /usr/share/munin/plugins/apache_watch_
Folgender inhalt muss da rein:
Code:
#!/usr/bin/perl
#
# Parameters supported:
#
#     config
#     autoconf
#
# Configurable variables
#
#     url      - Override default status-url
#
# Must be symlinked to what the graph should monitor. Run with --suggest
# to see valid targets - or just run munin-node-configure --shell
#
# Written by Bj�rn Ruberg 2006-2007
#
# Magic markers:
#%# family=auto
#%# capabilities=autoconf suggest

my $ret = undef;
if (!eval "require LWP::UserAgent;") {
  $ret = "LWP::UserAgent not found";
}

# watch-list exists on localhost
# watch-info does not

my %plugs = (
         'bytes'     => 'Input/output (bytes)',
         'requests'  => 'Requests',
         'documents' => 'Documents served',
            );

my $URL = exists $ENV{'url'} ? $ENV{'url'} : "http://localhost:%d/watch-list";
my @PORTS = exists $ENV{'ports'} ? split(' ', $ENV{'ports'}) : (80);
my $type = "throughput";

if (exists $ARGV[0] and $ARGV[0] eq "autoconf") {
  if ($ret) {
    print "no ($ret)\n";
    exit 1;
  }
  my $ua = LWP::UserAgent->new (timeout => 30);
  my @badports;
    
  foreach my $port (@PORTS) {
    my $url = sprintf $URL, $port;
    my $response = $ua->request (HTTP::Request->new('GET', $url));
    push @badports, $port unless $response->is_success;
  }
    
  if (@badports) {
    print "no (no mod_watch exists on ports @badports)\n";
    exit 1;
  } else {
    print "yes\n";
    exit 0;
  }
}

if (exists $ARGV[0] and $ARGV[0] eq "suggest") {
  while (my ($key, undef) = each %plugs) {
    print "$key\n";
  }
  exit 0;
}

my @servers = ();
my @data;
foreach my $port (@PORTS) {
  my $ua = LWP::UserAgent->new (timeout => 30);
  my $url = sprintf $URL, $port;
  my $response = $ua->request (HTTP::Request->new ('GET', $url));
  foreach my $string (split (/\n/, $response->content)) {
    my ($server, undef, $ifInOctets, $ifOutOctets, $ifRequests,
        $ifDocuments) = split (/\s/, $string, 6);
    push @servers, $server unless $server eq "SERVER";
    push @data, "$server $ifInOctets $ifOutOctets $ifRequests $ifDocuments"
      unless $server eq "SERVER";
  }
}

# From here and out, the plugin must be run with a symlinked service.
my $check = join ("|", keys %plugs);
die ("Plugin must be symlinked to aspect to be monitored")
  unless $0 =~ /\_($check)$/;

my $action = $1;

if (exists $ARGV[0] and $ARGV[0] eq "config") {
  print "graph_title Apache $plugs{$action}\n";
  print "graph_args --base 1000 -l 0\n";
  print "graph_category apache\n";
  print "graph_vlabel activity\n";
  my $i = 0;
  foreach my $server (sort (@servers)) {
    (my $txtserver = $server) =~ s/(-|\.)/\_/g;
    my $draw = ($i==0) ? 'AREA' : 'STACK';
    if ($action eq "bytes") {
      print "${txtserver}.label $server\n";
      print "${txtserver}.draw $draw\n";
      print "${txtserver}.type COUNTER\n";
    } else {
      print "${txtserver}.label $server\n";
      print "${txtserver}.draw $draw\n";
      print "${txtserver}.type COUNTER\n";
    }
    $i++;
  }
  exit 0;
}

foreach my $string (sort (@data)) {
  my ($server, $ifInOctets, $ifOutOctets, $ifRequests, $ifDocuments) =
    split (/\s/, $string);
  (my $txtserver = $server) =~ s/(-|\.)/\_/g;
  if ($action eq "documents") {
    print "${txtserver}.value $ifDocuments\n";
  } elsif ($action eq "requests") {
    print "${txtserver}.value $ifRequests\n";
  } elsif ($action eq "bytes") {
    print "${txtserver}.value " . ($ifInOctets + $ifOutOctets) . "\n";
  }
}
Plugin in Munin bekannt machen
Code:
cd /etc/munin/plugins
ln -sf /usr/share/munin/plugins/apache_watch_ apache_watch_
ln -sf /usr/share/munin/plugins/apache_watch_ apache_watch_bytes
ln -sf /usr/share/munin/plugins/apache_watch_ apache_watch_documents
ln -sf /usr/share/munin/plugins/apache_watch_ apache_watch_requests
/etc/init.d/munin-node restart
Testen:
Code:
cd /usr/local/sbin/
./mod_watch.pl -f ifRequests,ifDocuments http://127.0.0.1/watch-list/
Es sollte eine Ausgabe erfolgen
Code:
2294
165
1:20.25
SERVER
Plugin configurieren und links testen:
Code:
cd /usr/share/munin/plugins/
./apache_watch_ autoconf
./apache_watch_ suggest
munin-run apache_watch_bytes
munin-run apache_watch_documents
munin-run apache_watch_requests

Das ist jetzt einfach mal quick & dirty sollte aber gehen.

Greez BeNe
10-18-2007 07:50 PM
Visit this user's website Find all posts by this user Quote this message in a reply
fulltilt Offline
Member
***

Posts: 1,225
Joined: Apr 2007
Reputation: 5
Post: #55
RE: vhost monitoring
Hi BeNe,

werde ich gleich mal durchtesten.
Irgendwo habe ich noch etwas in der apache_watch_ oder mod_watch.c gesehen wg. ddos Prevention ...
Das sollte man vieleicht noch checken.
10-18-2007 07:59 PM
Find all posts by this user Quote this message in a reply
BeNe Offline
Moderator
*****
Moderators

Posts: 5,899
Joined: Jan 2007
Reputation: 68
Post: #56
RE: vhost monitoring
Habe jetzt auf die schnelle nix wegen DDos gefunden Rolleyes
Jetzt sind ein paar Domains drin, habe einfach mal welche auf das Demo gelegt und es schein wirklich gut zu funktionieren.
Jeder vHost ist eingetragen worden.

[Image: vhostbx5.th.jpg]

Greez BeNe
10-18-2007 10:12 PM
Visit this user's website Find all posts by this user Quote this message in a reply
fulltilt Offline
Member
***

Posts: 1,225
Joined: Apr 2007
Reputation: 5
Post: #57
RE: vhost monitoring
Ja klappt alles prima ...
Bei mir werden momentan nicht alle v-hosts angezeigt ...
Da liegt wohl am Traffic des/ der Webs.

Habe das Teil nochmal etwas überarbeitet:

Code:
apt-get install apache2-dev libcrypt-ssleay-perl libwww-perl
a2enmod info
a2enmod status
/etc/init.d/apache2 force-reload

####################################################
oder bei apache prefork
apt-get install apache2-prefork-dev libcrypt-ssleay-perl libwww-perl
a2enmod info
a2enmod status
/etc/init.d/apache2 force-reload
###################################################
Code:
cd /root
wget http://forums.cacti.net/download.php?id=8888
mv download.php\?id\=8888 mod_watch-4.3_apache22_mod.tar.gz
tar -xvzf mod_watch-4.3_apache22_mod.tar.gz
cd mod_watch-4.3_apache22_mod
nano Makefile.dso
Code:
anpassen der makefile.dso
(bei Debian 4.0)

# The location of apxs utility.
#
#APXS=/home/apache2/bin/apxs
APXS=/usr/bin/apxs2

#
# The location of apachectl utility to stop/start/restart targets.
#
APACHECTL=apache2ctl

#
# Where the scripts should live
#
SCRIPTDIR=/usr/local/sbin

#
# Where to store the weenie files.
#
STATEDIR=/usr/lib/apache2/modules/mod_watch/

#
# Define to use unsigned long long counters.
#
#BIG=-DUSE_OCTET_COUNTER_64

#
# Extras
#
DEF=$(BIG) -DSTATEDIR='\"$(STATEDIR)\"'
INC=
LIB=

cd /root/mod_watch-4.3_apache22_mod
Code:
make -f Makefile.dso build
make -f Makefile.dso install
Code:
nano /etc/apache2/httpd.conf
einfügen falls nicht schon vorhanden:

LoadModule watch_module /usr/lib/apache2/modules/mod_watch.so
Code:
apache2.conf > ändern
nano /etc/apache2/apache2.conf

<IfModule mod_status.c>
    #
    # Allow server status reports generated by mod_status,
    # with the URL of http://servername/server-status
    # Change the ".example.com" to match your domain to enable.
    #
    ExtendedStatus On
    <Location /server-status>
        SetHandler server-status
        Order deny,allow
        Deny from all
        Allow from 127.0.0.1
    </Location>
</IfModule>

<IfModule mod_info.c>

     #Allow remote server configuration reports, with the URL of
     # http://servername/server-info (requires that mod_info.c be loaded).
     #Change the ".example.com" to match your domain to enable.

    <Location /server-info>
        SetHandler server-info
        Order deny,allow
        Deny from all
        Allow from 127.0.0.1
    </Location>
</IfModule>


<IfModule mod_watch.c>
    # Allows the URL used to query virtual host data:
    #
    # http://www.snert.com/watch-info
    #
    <Location /watch-info>
    SetHandler watch-info
    Order allow,deny
    Allow from 127.0.0.1
    </Location>


    # Intended for debugging and analysis of shared memory
    # hash table and weenie files:
    #
    #http://127.0.0.1/watch-table
    #

    <Location /watch-table>
    SetHandler watch-table
    Order allow,deny
    Allow from 127.0.0.1
    </Location>

    <Location /watch-list>
    SetHandler watch-list
    Order allow,deny
    Allow from 127.0.0.1
    </Location>
</IfModule>

Code:
cd /root/mod_watch-4.3_apache22_mod
cp mod_watch.c /usr/share/munin/plugins/
chmod 755 /usr/share/munin/plugins/mod_watch.c

/etc/init.d/apache2 force-reload
Code:
nano /usr/share/munin/plugins/apache_watch_
einfügen >

#!/usr/bin/perl
#
# Parameters supported:
#
#     config
#     autoconf
#
# Configurable variables
#
#     url      - Override default status-url
#
# Must be symlinked to what the graph should monitor. Run with --suggest
# to see valid targets - or just run munin-node-configure --shell
#
# Written by Bj�rn Ruberg 2006-2007
#
# Magic markers:
#%# family=auto
#%# capabilities=autoconf suggest

my $ret = undef;
if (!eval "require LWP::UserAgent;") {
  $ret = "LWP::UserAgent not found";
}

# watch-list exists on localhost
# watch-info does not

my %plugs = (
         'bytes'     => 'Input/output (bytes)',
         'requests'  => 'Requests',
         'documents' => 'Documents served',
            );

my $URL = exists $ENV{'url'} ? $ENV{'url'} : "http://localhost:%d/watch-list";
my @PORTS = exists $ENV{'ports'} ? split(' ', $ENV{'ports'}) : (80);
my $type = "throughput";

if (exists $ARGV[0] and $ARGV[0] eq "autoconf") {
  if ($ret) {
    print "no ($ret)\n";
    exit 1;
  }
  my $ua = LWP::UserAgent->new (timeout => 30);
  my @badports;
    
  foreach my $port (@PORTS) {
    my $url = sprintf $URL, $port;
    my $response = $ua->request (HTTP::Request->new('GET', $url));
    push @badports, $port unless $response->is_success;
  }
    
  if (@badports) {
    print "no (no mod_watch exists on ports @badports)\n";
    exit 1;
  } else {
    print "yes\n";
    exit 0;
  }
}

if (exists $ARGV[0] and $ARGV[0] eq "suggest") {
  while (my ($key, undef) = each %plugs) {
    print "$key\n";
  }
  exit 0;
}

my @servers = ();
my @data;
foreach my $port (@PORTS) {
  my $ua = LWP::UserAgent->new (timeout => 30);
  my $url = sprintf $URL, $port;
  my $response = $ua->request (HTTP::Request->new ('GET', $url));
  foreach my $string (split (/\n/, $response->content)) {
    my ($server, undef, $ifInOctets, $ifOutOctets, $ifRequests,
        $ifDocuments) = split (/\s/, $string, 6);
    push @servers, $server unless $server eq "SERVER";
    push @data, "$server $ifInOctets $ifOutOctets $ifRequests $ifDocuments"
      unless $server eq "SERVER";
  }
}

# From here and out, the plugin must be run with a symlinked service.
my $check = join ("|", keys %plugs);
die ("Plugin must be symlinked to aspect to be monitored")
  unless $0 =~ /\_($check)$/;

my $action = $1;

if (exists $ARGV[0] and $ARGV[0] eq "config") {
  print "graph_title Apache $plugs{$action}\n";
  print "graph_args --base 1000 -l 0\n";
  print "graph_category apache\n";
  print "graph_vlabel activity\n";
  my $i = 0;
  foreach my $server (sort (@servers)) {
    (my $txtserver = $server) =~ s/(-|\.)/\_/g;
    my $draw = ($i==0) ? 'AREA' : 'STACK';
    if ($action eq "bytes") {
      print "${txtserver}.label $server\n";
      print "${txtserver}.draw $draw\n";
      print "${txtserver}.type COUNTER\n";
    } else {
      print "${txtserver}.label $server\n";
      print "${txtserver}.draw $draw\n";
      print "${txtserver}.type COUNTER\n";
    }
    $i++;
  }
  exit 0;
}

foreach my $string (sort (@data)) {
  my ($server, $ifInOctets, $ifOutOctets, $ifRequests, $ifDocuments) =
    split (/\s/, $string);
  (my $txtserver = $server) =~ s/(-|\.)/\_/g;
  if ($action eq "documents") {
    print "${txtserver}.value $ifDocuments\n";
  } elsif ($action eq "requests") {
    print "${txtserver}.value $ifRequests\n";
  } elsif ($action eq "bytes") {
    print "${txtserver}.value " . ($ifInOctets + $ifOutOctets) . "\n";
  }
}
Code:
dann:
chmod 755 /usr/share/munin/plugins/apache_watch_

ln -s /usr/share/munin/plugins/apache_watch_ /etc/munin/plugins/apache_watch_bytes
ln -s /usr/share/munin/plugins/apache_watch_ /etc/munin/plugins/apache_watch_documents
ln -s /usr/share/munin/plugins/apache_watch_ /etc/munin/plugins/apache_watch_requests

cd /usr/share/munin/plugins/
./apache_watch_ autoconf

/etc/init.d/apache2 restart
/etc/init.d/munin-node restart
Code:
Test:
cd /usr/local/sbin/
./mod_watch.pl -f ifRequests,ifDocuments http://127.0.0.1/watch-list/
69
13
6.10
SERVER

cd /usr/share/munin/plugins/
munin-run apache_watch_bytes config
munin-run apache_watch_documents config
munin-run apache_watch_requests config

Wenn keine Fehler auftauchen sollte alles O.K. sein.
(This post was last modified: 10-18-2007 10:31 PM by fulltilt.)
10-18-2007 10:20 PM
Find all posts by this user Quote this message in a reply
fulltilt Offline
Member
***

Posts: 1,225
Joined: Apr 2007
Reputation: 5
Post: #58
RE: vhost monitoring
Dauert ein wenig bis alle v-hosts erscheinen ... habs mal auf einem echten Server getestet werden jetzt 30 von 60 Webs angezeigt ... wächst noch.
10-18-2007 10:30 PM
Find all posts by this user Quote this message in a reply
BeNe Offline
Moderator
*****
Moderators

Posts: 5,899
Joined: Jan 2007
Reputation: 68
Post: #59
RE: vhost monitoring
Hoffe das es noch wächst...
Ok - dann haben wir es ja doch Geschafft [Image: e016.gif]
Ich werde das so ins Wiki aufnehmen.
Habe auch schon wieder neue Sachen im Kopf, habe das Plugin für ProFTPD,Postfix,AMaVIS,Dovecot gesehen Big Grin Werde ich nach und nach mal testen...

Danke für deine Zusammenarbeit!

Greez BeNe
(This post was last modified: 10-18-2007 10:49 PM by BeNe.)
10-18-2007 10:41 PM
Visit this user's website Find all posts by this user Quote this message in a reply
fulltilt Offline
Member
***

Posts: 1,225
Joined: Apr 2007
Reputation: 5
Post: #60
RE: vhost monitoring
Hi BeNe,

Bedanken muss ich mich wohl eher bei Dir Big Grin

Ist wirklich sehr hilfreich das Teil, auch gerade wenn von einem löchrigen Script in einem Web Attacken gefahren werden.
So hat man immer alles im Blick.

Es gibt auch noch ein Plugin für Fail2Ban ... ist sicher auch interessant.

BeNe Wrote:Hoffe das es noch wächst...
Ok - dann haben wir es ja doch Geschafft [Image: e016.gif]
Ich werde das so ins Wiki aufnehmen.
Habe auch schon wieder neue Sachen im Kopf, habe das Plugin für ProFTPD,Postfix,AMaVIS,Dovecot gesehen Big Grin Werde ich nach und nach mal testen...

Danke für deine Zusammenarbeit!

Greez BeNe
10-18-2007 10:57 PM
Find all posts by this user Quote this message in a reply
Post Reply 


Forum Jump:


User(s) browsing this thread: 1 Guest(s)