i have a netapp.
the mibs are all new all the time since it is an enclosure.
i am using nagios.
my old nagios scripts do not work with my netapp.
here are some variables and here are some snmp oid changes:
FAN 1.3.6.1.4.1.789.1.21.1.2.1.18
PS 1.3.6.1.4.1.789.1.21.1.2.1.15
TEMP 1.3.6.1.4.1.789.1.21.1.2.1.27
thanks:
http://www.mibdepot.com/cgi-bin/getmib3.cgi?win=mib_a&r=netapp&f=netapp_2_2_2.mib&v=v2&t=tree
Monday, December 12, 2016
netapp mibs changes or curse you snmp
Thursday, December 8, 2016
openvas is having a bad day on debian 8.2
openvas is having a bad day on debian 8.2
i am seeing:
Operation: Start Task
Status code: 503
Status message: Service temporarily down
and to make things worse:
lib serv:WARNING:2016-12-07 10h00.00 UTC:4546: Failed to shake hands with peer:
The TLS connection was non-properly terminated.
lib serv:WARNING:2016-12-07 10h00.00 UTC:4546: Failed to shutdown server socket
event task:MESSAGE:2016-12-07 10h00.00 UTC:4546: Task could not be started by admin
great.
that means my certs are out of date. guess i need to update them.
# systemctl stop openvas-scanner
# systemctl stop openvas-manager
# openvas-mkcert -f
# openvas-mkcert-client -i -n
# openvasmd --get-scanners
08b69003-5fc2-4037-a479-93b440211c73 OpenVAS Default <- unique to each install
# ls -la /usr/local/var/lib/openvas/private/CA/
yes. that's where the keys are located.
# openvasmd --modify-scanner "08b69003-5fc2-4037-a479-93b440211c73" \
--scanner-ca-pub /usr/local/var/lib/openvas/CA/cacert.pem \
--scanner-key-pub /usr/local/var/lib/openvas/CA/clientcert.pem \
--scanner-key-priv /usr/local/var/lib/openvas/private/CA/clientkey.pem
# openvas-nvt-sync
# openvasmd --rebuild
# systemctl start openvas-manager
# systemctl start gsa
done
Thursday, December 1, 2016
backup /etc on ubuntu 12.04
because i need /etc .
run to output installed packages... this helps with system restore, if
needed.
etc_backup.sh
#!/bin/bash
# Script to backup the /etc heirarchy
#
# Written 4/2002 by Wayne Pollock, Tampa Florida USA
#
# $Id: backup-etc,v 1.6 2004/08/25 01:42:26 wpollock Exp $
#
# $Log: backup-etc,v $
#
# Revision 1.6 2004/08/25 01:42:26 wpollock
# Changed backup name to include the hostname and 4 digit years.
#
# Revision 1.5 2004/01/07 18:07:33 wpollock
# Fixed dots routine to count files first, then calculate files per dot.
#
# Revision 1.4 2003/04/03 08:10:12 wpollock
# Changed how the version number is obtained, so the file
# can be checked out normally.
#
# Revision 1.3 2003/04/03 08:01:25 wpollock
# Added ultra-fancy dots function for verbose mode.
#
# Revision 1.2 2003/04/01 15:03:33 wpollock
# Eliminated the use of find, and discovered that tar was working
# as intended all along! (Each directory that find found was
# recursively backed-up, so for example /etc, then /etc/mail,
# caused /etc/mail/sendmail.mc to be backuped three times.)
#
# Revision 1.1 2003/03/23 18:57:29 wpollock
# Modified by Wayne Pollock:
#
# Discovered not all files were being backed up, so
# added "-print0 --force-local" to find and "--null -T -"
# to tar (eliminating xargs), to fix the problem when filenames
# contain metacharacters such as whitespace.
# Although this now seems to work, the current version of tar
# seems to have a bug causing it to backup every file two or
# three times when using these options! This is still better
# than not backing up some files at all.)
#
# Changed the logger level from "warning" to "error".
#
# Added '-v, --verbose' options to display dots every 60 files,
# just to give feedback to a user.
#
# Added '-V, --version' and '-h, --help' options.
#
# Removed the lock file mechanism and backup file renaming
# (from foo to foo.1), in favor of just including a time-stamp
# of the form "yymmdd-hhmm" to the filename.
#
PATH=/bin:/usr/bin
REPOSITORY=/opt/etc_backups/
TIMESTAMP=$(date '+%Y%m%d')
HOSTNAME=$(hostname -s)
FILE="$REPOSITORY/$HOSTNAME-$TIMESTAMP.tgz"
ERRMSGS=/tmp/backup-etc.$$
PROG=${0##*/}
VERSION=$(echo $Revision: 1.6 $ |awk '{print$2}')
VERBOSE=off
usage()
{ echo "This script creates a full backup of /etc via tar in $REPOSITORY."
echo "Usage: $PROG [OPTIONS]"
echo ' Options:'
echo ' -v, --verbose displays some feedback (dots) during backup'
echo ' -h, --help displays this message'
echo ' -V, --version display program version and author info'
echo
}
dots()
{ MAX_DOTS=50
NUM_FILES=`find /etc|wc -l`
let 'FILES_PER_DOT = NUM_FILES / MAX_DOTS'
bold=`tput smso`
norm=`tput rmso`
tput sc
tput civis
echo -n "$bold(00%)$norm"
while read; do
let "cnt = (cnt + 1) % FILES_PER_DOT"
if [ "$cnt" -eq 0 ]
then
let '++num_dots'
let 'percent = (100 * num_dots) / MAX_DOTS'
[ "$percent" -gt "100" ] && percent=100
tput rc
printf "$bold(%02d%%)$norm" "$percent"
tput smir
echo -n "."
tput rmir
fi
done
tput cnorm
echo
}
# Command line argument processing:
while [ $# -gt 0 ]
do
case "$1" in
-v|--verbose) VERBOSE=on; ;;
-h|--help) usage; exit 0; ;;
-V|--version) echo -n "$PROG version $VERSION "
echo 'Written by Wayne Pollock <pollock@acm.org>'
exit 0; ;;
*) usage; exit 1; ;;
esac
shift
done
trap "rm -f $ERRMSGS" EXIT
cd /etc
# create backup, saving any error messages:
if [ "$VERBOSE" != "on" ]
then
tar -cz --force-local -f $FILE . 2> $ERRMSGS
else
tar -czv --force-local -f $FILE . 2> $ERRMSGS | dots
fi
# Log any error messages produced:
if [ -s "$ERRMSGS" ]
then logger -p user.error -t $PROG "$(cat $ERRMSGS)"
else logger -t $PROG "Completed full backup of /etc"
fi
exit 0
run to output installed packages... this helps with system restore, if
needed.
50 22 * * * root /usr/bin/dpkg --get-selections > /etc/package-list.txt
00 23 * * * root /usr/local/scripts/etc_backup.sh
bash scripts to backup svn server
there is nothing nearer and dearer to my heart than my svn server. if i lost it i would be unhappy for a very long time.
i have a bunch of scripts here:
/nfserver/bin
why? because if i lost my nfs mounts, my scripts would not work and i would not have to deal with my fs filling up.
yes, i could check for the mount being active, but why bother? i like keeping all my eggs in one basket.
i have a bunch of scripts here:
/nfserver/bin
why? because if i lost my nfs mounts, my scripts would not work and i would not have to deal with my fs filling up.
yes, i could check for the mount being active, but why bother? i like keeping all my eggs in one basket.
svn_backup.sh
#!/bin/bash
# set values
repos=( repo1 repo2 repo3 )
rpath=/var/svn/repositories
opath=/nfsmount/svn
tpath=/tmp/svn
suffix=$(date +%Y-%m-%d)
#check if we need to make output path
if [ -d $opath ]
then
# directory exists, we are good to continue
filer="just some action to prevent syntax error"
else
#we need to make the directory
echo Creating $opath
mkdir -p $opath
fi
# remove contents of tmp
rm -rf $tpath
mkdir -p $tpath
for (( i = 0 ; i < ${#repos[@]} ; i++ ))
do
svnadmin hotcopy $rpath/${repos[$i]} ${tpath}/${repos[$i]}_$suffix.hotcopy
#now compress them
tar -czf ${opath}/${repos[$i]}_$suffix.hotcopy.tar.gz -C ${tpath}/${repos[$i]}_$suffix.hotcopy .
if [ -s error ]
then
printf "WARNING: An error occured while attempting to backup %s \n\tError:\n\t" ${repos[$i]}
cat error
rm -f er
else
printf "%s was backed up successfully \n\n" ${repos[$i]} $SVNDUMP
fi
done
hotcopy will backup db, and that's about it.
we need confs. hooks. and stuff. logs meh.
the svn server has the following layout:
> hookscripts
mailer.conf
no-archives.py
post-commit
pre-commit
pre-revprop-change
readme.txt
svnperms.conf
svnperms.py
> logs
commit-email.log
repo-pre-commit
svn_logfile
> repositories
> repo
> conf
> dav
> db
> format
> hooks
> locks
svn_apacheconf_backup.sh
#!/bin/bash
# set values
apacheconf=( /etc/apache2 )
svnconf=( /var/svn/hookscripts )
repos=( repo1 repo2 repo3 )
confdirs=( conf hooks )
rpath=/var/svn/repositories
opath=/nfsmount/svn
suffix=$(date +%Y-%m-%d)
#check if we need to make path
if [ -d $opath ]
then
# directory exists, we are good to continue
filler="just some action to prevent syntax error"
else
#we need to make the directory
echo Creating $opath
mkdir -p $opath
fi
#now do the apache backup
APACHECONFDUMP=${opath}/apacheconf_$suffix.tar.gz
tar -zcvf $APACHECONFDUMP $apacheconf 2>&1
if [ -s error ]
then
printf "WARNING: An error occured while attempting to backup %s \n\tError:\n\t" $apacheconf
cat error
rm -f er
else
printf "%s was backed up successfully \n\n" $APACHECONFDUMP
fi
#now do the svn conf backup
SVNCONFDUMP=${opath}/svnconf_$suffix.tar.gz
tar -zcvf $SVNCONFDUMP $svnconf 2>&1
if [ -s error ]
then
printf "WARNING: An error occured while attempting to backup %s \n\tEr$
cat error
rm -f er
else
printf "%s was backed up successfully \n\n" $SVNCONFDUMP
fi
#now to do the config backups
for (( i = 0; i < ${#repos[@]} ; i++ ))
do
for (( j = 0 ; j < ${#confdirs[@]} ; j++ ))
do
CONFDUMP=${opath}/${repos[i]}_${confdirs[j]}_$suffix.tar.gz
CONFDIR=${rpath}/${repos[i]}/${confdirs[j]}
tar -zcvf $CONFDUMP $CONFDIR 2>&1
if [ -s error ]
then
printf "WARNING: An error occured while attempting to backup %s \n\tError:\n\t" $CONFDIR
cat error
rm -f er
else
printf "%s was backed up successfully \n\n" $CONFDUMP
fi
done
done
svn_purgebackups.sh
#!/bin/bash
#this script will run through all nested directories of a parent just killing off all matching files.
######
### Set these values
######
## default days to retain (override with .RETAIN_RULE in specific directory
DEFRETAIN=7
#want to append the activity to a log? good idea, add its location here
LOGFILE=/nfsmount/svn/removed.log
# enter the distinguishing extension, or portion of the filename here (eg. log, txt, etc.)
EXTENSION=gz
#the absolute path of folder to begin purging
#this is the top most file to begin the attack, all sub directories contain lowercase letters and periods are game.
DIRECTORY=/nfsmount/svn
#####
## End user configuartion
#####
#this note will remind you that you have a log in case your getting emails from a cron job or something
echo see $LOGFILE for details
#jump to working directory
cd $DIRECTORY
#if your sub-dirs have some crazy characters you may adjust this regex
DIRS=`ls | grep ^[a-z.]*$`
TODAY=`date`
printf "\n\n********************************************\n\tSVN Purge Log for:\n\t" | tee -a $LOGFILE
echo $TODAY | tee -a $LOGFILE
printf "********************************************\n" $TODAY | tee -a $LOGFILE
for DIR in $DIRS
do
pushd $DIR >/dev/null
HERE=`pwd`
printf "\n\n%s\n" $HERE | tee -a $LOGFILE
if [ -f .RETAIN_RULE ]
then
printf "\tdefault Retain period being overridden\n" | tee -a $LOGFILE
read RETAIN < .RETAIN_RULE
else
RETAIN=$DEFRETAIN
fi
printf "\tpurging files older than %s days\n" ${RETAIN} | tee -a $LOGFILE
OLDFILES=`find -mtime +${RETAIN} -regex .*${EXTENSION}.*`
set -- $OLDFILES
if [ -z $1 ]
then
printf "\tNo files matching purge criteria\n" | tee -a $LOGFILE
else
printf "\tDump Files being deleted from $HERE\n" | tee -a $LOGFILE
printf "\t\t%s\n" $OLDFILES | tee -a $LOGFILE
fi
rm -f $OLDFILES
if [ $? -ne 0 ]
then
echo "Error while deleting last set" | tee -a $LOGFILE
exit 2
else
printf "\tSuccess\n" | tee -a $LOGFILE
fi
popd >/dev/null
done
15 0 * * * /nfsmount/bin/svn_backup.sh | mail -s "svn hotcopy report" me@there.com 2>&1
25 0 * * * /nfsmount/bin/svn_apacheconf_backup.sh | mail -s "svn apacheconf report" me@there.com 2>&1
45 1 * * * /nfsmount/bin/svn_purgebackups.sh | mail -s "purge archive report" me@there.com 2>&1
Wednesday, November 30, 2016
compile and install nagios nrpe 2.15 on ubuntu 12.04 lts
compile and install nagios nrpe 2.15 on ubuntu 12.04 lts
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=12.04
DISTRIB_CODENAME=precise
DISTRIB_DESCRIPTION="Ubuntu 12.04.3 LTS"
download and install gz'd code in /usr/local/src
add nagios user
# useradd -c "nagios system user" -d /usr/local/nagios -m nagios
# groupadd nagios
# chown nagios:nagios /usr/local/nagios
compile and install nrpe
# gunzip nrpe-2.15.tar.gz
# tar xvf nrpe-2.15.tar
# cd nrpe-2.15
# ./configure --with-ssl=/usr/bin/openssl --with-ssl-lib=/usr/lib/x86_64-linux-gnu
# make && make install
/usr/bin/install -c -m 775 -o nagios -g nagios -d /usr/local/nagios/bin
/usr/bin/install -c -m 775 -o nagios -g nagios nrpe /usr/local/nagios/bin
# make install-daemon-config
/usr/bin/install -c -m 775 -o nagios -g nagios -d /usr/local/nagios/etc
/usr/bin/install -c -m 644 -o nagios -g nagios sample-config/nrpe.cfg /usr/local/nagios/etc
# gunzip nagios-plugins-1.4.16.tar.gz
# tar xvf nagios-plugins-1.4.16.tar
# cd nagios-plugins-1.4.16/
# ./configure --without-mysql
# make && make install
...
* note
i'm hardcoding the libs for nrpe because
configure does this...
checking for type of socket size... size_t
checking for SSL headers... SSL headers found in /usr
checking for SSL libraries... configure: error: Cannot find ssl libraries
meh
# apt-get install libssl-dev
# ldconfing
# apt-file search libssl | grep libssl-dev
...
set up the nrpe daemon
# echo 'nrpe 5666/tcp # NRPE' >> /etc/services
# cp /usr/local/src/nrpe-2.15/init-script.debian /etc/init.d/nrpe
# chmod +x /etc/init.d/nrpe
# sysv-rc-conf
set to runlevels 2 3 4 5
q to exit :^)
edit nrpe.cfg to site specs
# vi /usr/local/nagios/etc/nrpe.cfg
run nrpe daemon
# /etc/init.d/nrpe start
running?
# netstat -an |grep 5666
tcp 0 0 0.0.0.0:5666 0.0.0.0:* LISTEN
tcp6 0 0 :::5666 :::* LISTEN
check if npre is accessible. the rev show show up.
# /usr/local/nagios/libexec/check_nrpe -H localhost
NRPE v2.15
useradd -c "nagios system user" -d /usr/local/nagios -m nagios ;
chown nagios:nagios /usr/local/nagios ;
mkdir -p /usr/local/src ;
cd /usr/local/src ;
scp you@somewhere:/dir/nrpe-2.15.tar.gz . ;
scp you@somewhere:/dir/nagios-plugins-1.4.16.tar.gz . ;
scp you@somewhere:/dir/templates/* . ;
gunzip nrpe-2.15.tar.gz ;
tar xvf nrpe-2.15.tar ;
gunzip nagios-plugins-1.4.16.tar.gz ;
tar xvf nagios-plugins-1.4.16.tar ;
cd nrpe-2.15 ;
./configure --with-ssl=/usr/bin/openssl --with-ssl-lib=/usr/lib/x86_64-linux-gnu ;
make && make install ;
make install-daemon-config ;
cd ../nagios-plugins-1.4.16 ;
./configure --without-mysql ;
make && make install ;
cp /usr/local/src/nrpe.cfg /usr/local/nagios/etc/ ;
echo 'nrpe 5666/tcp # NRPE' >> /etc/services ;
cp /usr/local/src/nrpe-2.15/init-script.debian /etc/init.d/nrpe ;
chmod +x /etc/init.d/nrpe
common prereqs:
libssl-dev
apt-file
sysv-rc-conf
note:
if you see the make error in npre section (make will not tell you, you have to watch the process):
./nrpe.c:269: undefined reference to `get_dh512'
a hint is when you rn /etc/init.d/nrpe and do not see the output:
Starting nagios remote plugin daemon: nrpe.
edit dh.h with C-code output if openssl is installed.
# openssl dhcparam -C 512 > /usr/local/src/nrpe-2.15/include/dh.h
and removing all between:
-----BEGIN DH PARAMETERS-----
-----END DH PARAMETERS-----
if running openssl comes up as not found,
apt-get install openssl
for ubuntu 10 and lower:
--with-ssl=/usr/bin/openssl --with-ssl-lib=/usr/lib
if you do not want to roll your own:
apt-get install nagios-nrpe-server
apt-get install nagios-plugins
apt-get install nagios-plugins-basic
apt-get install nagios-plugins-standard
all the conf stuff resides in:
/etc/nagios
...
a basic-o-rama template (npre.cfg):
#############################################################################
# NRPE Config File
#
# Last Modified: TODAY!
#############################################################################
# LOG FACILITY
log_facility=daemon
# PID FILE
pid_file=/var/run/nrpe.pid
# PORT NUMBER
server_port=5666
# SERVER ADDRESS
#server_address=127.0.0.1
# NRPE USER
nrpe_user=nagios
# NRPE GROUP
nrpe_group=nagios
# ALLOWED HOST ADDRESSES
# NOTE: This option is ignored if NRPE is running under either inetd or xinetd
# losthost and monitoring servers
allowed_hosts=127.0.0.1,128.6.6.6,10.5.5.5
# COMMAND ARGUMENT PROCESSING
dont_blame_nrpe=0
# BASH COMMAND SUBTITUTION
allow_bash_command_substitution=0
# DEBUGGING OPTION
# Values: 0=debugging off, 1=debugging on
debug=0
# COMMAND TIMEOUT
command_timeout=60
# COMMAND DEFINITIONS
# The following examples use hardcoded command arguments...
command[check_users]=/usr/local/nagios/libexec/check_users -w 5 -c 10
command[check_load]=/usr/local/nagios/libexec/check_load -w 15,10,5 -c 30,25,20
command[check_root]=/usr/local/nagios/libexec/check_disk -w 20% -c 10% -p /
command[check_zombie_procs]=/usr/local/nagios/libexec/check_procs -w 5 -c 10 -s Z
command[check_total_procs]=/usr/local/nagios/libexec/check_procs -w 600 -c 900
Tuesday, November 29, 2016
check_vmware_api.pl install is perl hell
Prerequisites:
- Ubuntu 14.04 Server (perl v5.18.2)
- VMware-vSphere-Perl-SDK-5.5.0-2043780
- check_vmware_api.pl 0.7.1
Basic installation:
apt-get install perl-doc libssl-dev libxml-libxml-perl libarchive-zip-perl libcrypt-ssleay-perl libclass-methodmaker-perl libuuid-perl libdata-dump-perl libsoap-lite-perl libio-compress-perl
tar -xf VMware-vSphere-Perl-SDK-5.5.0-2043780.x86_64.tar.gz -C /tmp
cd /tmp/vmware-vsphere-cli-distrib
./vmware-install.pl
...
cpan[3]> i /libwww-perl/
Distribution GAAS/libwww-perl-5.837.tar.gz
Distribution GAAS/libwww-perl-6.01.tar.gz
Distribution GAAS/libwww-perl-6.05.tar.gz
Author LWWWP ("The libwww-perl mailing list" <libwww@perl.org>)
4 items found
cpan[4]> install GAAS/libwww-perl-5.837.tar.gz
Running make for G/GA/GAAS/libwww-perl-5.837.tar.gz
Checksum for /root/.cpan/sources/authors/id/G/GA/GAAS/libwww-perl-5.837.tar.gz ok
...
http://search.cpan.org/dist/Nagios-Plugin/lib/Nagios/Plugin.pm
Nagios::Monitoring::Plugin
Nagios::Plugin <- no longer
...
Work around for "Server version unavailable":
patch -b /usr/share/perl/5.14/VMware/VICommon.pm new(agent => "VI Perl");
+ $user_agent->ssl_opts( SSL_verify_mode => 0 );
my $cookie_jar = HTTP::Cookies->new(ignore_discard => 1);
$user_agent->cookie_jar($cookie_jar);
$user_agent->protocols_allowed(['http', 'https']);
@@ -502,7 +503,7 @@
sub query_server_version {
BEGIN {
#To remove SSL Warning, switching from IO::Socket::SSL to Net::SSL
- $ENV{PERL_NET_HTTPS_SSL_SOCKET_CLASS} = "Net::SSL";
+ #$ENV{PERL_NET_HTTPS_SSL_SOCKET_CLASS} = "Net::SSL";
#To remove host verification
$ENV{PERL_LWP_SSL_VERIFY_HOSTNAME} = 0;
}
@@ -526,6 +527,7 @@
}
}
my $user_agent = LWP::UserAgent->new(agent => "VI Perl");
+ $user_agent->ssl_opts( SSL_verify_mode => 0 );
my $cookie_jar = HTTP::Cookies->new(ignore_discard => 1);
$user_agent->cookie_jar($cookie_jar);
$user_agent->protocols_allowed(['http', 'https']);
@@ -2108,6 +2110,7 @@
sub new {
my ($class, $url) = @_;
my $user_agent = LWP::UserAgent->new(agent => "VI Perl");
+ $user_agent->ssl_opts( SSL_verify_mode => 0 );
my $cookie_jar = HTTP::Cookies->new(ignore_discard => 1);
$user_agent->cookie_jar( $cookie_jar );
$user_agent->protocols_allowed( ['http', 'https'] );
*****************************************************************
...
env -i perl -V
@INC is yucky.
command execution via _compile function in Maketext.pm
Built under linux
Compiled at Feb 4 2014 23:11:19
@INC:
/etc/perl
/usr/local/lib/perl/5.14.2
/usr/local/share/perl/5.14.2
/usr/lib/perl5
/usr/share/perl5
/usr/lib/perl/5.14
/usr/share/perl/5.14
/usr/local/lib/site_perl
All my new stuff is under /usr/local/lib/perl5/
and not /usr/local/lib/site_perl oh come on.
because
Can't locate Monitoring/Plugin/Functions.pm
find / | grep -i Functions.pm <- in 5.18.0
ln -s /usr/local/lib/perl5/site_perl/5.18.0 site_perl
because
Can't locate Params/Validate.pm
find / | grep -i Validate.pm <- in 5.24.0
cd /usr/local/lib/site_perl/Params
ln -s /usr/local/lib/perl5/site_perl/5.24.0/x86_64-linux/Params/Validate .
ln -s /usr/local/lib/perl5/site_perl/5.24.0/x86_64-linux/Params/Validate.pm .
ln -s /usr/local/lib/perl5/site_perl/5.24.0/x86_64-linux/Params/ValidatePP.pm .
ln -s /usr/local/lib/perl5/site_perl/5.24.0/x86_64-linux/Params/ValidateXS.pm .
Wednesday, November 16, 2016
setting a static address in alom
for whatever reason my alom network settings were not picking up dhcp.
that's okay. let's set a static address.
many sun servers, by the way, do not have scadm in the platform directory...
yeah. try it:
/usr/platform/`uname -i`/sbin/scadm
get to a service console via a serial connection, logon and issue:
setsc netsc_dhcp false
setsc netsc_ipaddr <ip address>
setsc netsc_ipnetmask <subnet mask>
setsc netsc_ipgateway <gateway address>
shownetwork <- is useless until you have issued resetsc -y
reset the alom to effect settings:
resetsc -y
Subscribe to:
Posts (Atom)