Home

sandip's blog

Check number of file descriptors opened by process

Fri, 03/25/2011 - 11:51 — sandip

To check on the file descriptors opened by process:

lsof -p {PID} | awk '$4 ~ /^[0-9]/ {print $4}' | wc -l

alternately:

ls -1 /proc/{PID}/fd | wc -l

To check all file descriptors opened by a user:

lsof -u {user} | awk '$4 ~ /^[0-9]/ {print $4}' | wc -l

By default the hard and soft limits for a single process are set to 1024 on linux systems. To check on the limits:

ulimit -Hn
ulimit -Sn

To increase edit the "/etc/security/limits.conf" file for corresponding user:

{user} soft nofile 4096
{user} hard nofile 4096

To check if the new limits has been applied type `ulimit -n` after you get a new shell.

Logfile '/var/log/kav/5.5/kav4mailservers/avstats.log' does not exist

Mon, 03/21/2011 - 14:05 — sandip

To resolve kluser cron error on missing log file:

Logfile '/var/log/kav/5.5/kav4mailservers/avstats.log' does not exist

Modify kluser cron as below via `crontab -e -u kluser` appending "/bin/touch /var/log/kav/5.5/kav4mailservers/avstats.log;":

/bin/touch /var/log/kav/5.5/kav4mailservers/avstats.log; /opt/kav/5.5/kav4mailservers/bin/parse_avstat.pl -d -sd=/opt/kav/5.5/kav4mailservers/proc_avstat /var/log/kav/5.5/kav4mailservers/avstats.log

Plesk and SPF records

Fri, 03/18/2011 - 10:56 — sandip

The Plesk DNS zone template for TXT record does not include the servers hostname by default. If the host IP is different from the domains being hosted, may want to update the default template as below:

<domain>. TXT v=spf1 +a +mx a:host.domain.tld -all

Backup and restore lvm data with dd

Sun, 03/13/2011 - 01:18 — sandip

Recently I've had to backup/restore data from a failing drive with LVM over Raid.

Luckily I had access to the backup of the current metadata configuration located in "/etc/lvm/backup/".

Below is what the volumegroup looked like:

vg0 {
    &nbsp;   id = "xvni1W-24Xu-dVoR-PlXh-gQvQ-62fL-QX64O3"
    &nbsp;   seqno = 9
    &nbsp;   status = ["RESIZEABLE", "READ", "WRITE"]
    &nbsp;   flags = []
    &nbsp;   extent_size = 65536    &nbsp;    &nbsp;   # 32 Megabytes
    &nbsp;   max_lv = 0
    &nbsp;   max_pv = 0

    &nbsp;   physical_volumes {

    &nbsp;    &nbsp;    &nbsp; pv0 {
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    id = "9gbyhX-Owvj-u4Q4-wR1E-IEf2-gyUA-CJBCJK"
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    device = "/dev/md3" &nbsp;   # Hint only

    &nbsp;    &nbsp;    &nbsp;    &nbsp;    status = ["ALLOCATABLE"]
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    flags = []
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    dev_size = 1928892288   # 919.768 Gigabytes
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    pe_start = 384
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    pe_count = 29432    &nbsp;   # 919.75 Gigabytes
    &nbsp;    &nbsp;    &nbsp; }
    &nbsp;   }

    &nbsp;   logical_volumes {

    &nbsp;    &nbsp;    &nbsp; lv0_sites {
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    id = "Sg1fYr-NTzr-8AA2-v29K-tcz5-rUMj-uRoXY1"
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    status = ["READ", "WRITE", "VISIBLE"]
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    flags = []
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    segment_count = 1

    &nbsp;    &nbsp;    &nbsp;    &nbsp;    segment1 {
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;  start_extent = 0
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;  extent_count = 1280     # 40 Gigabytes

    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;  type = "striped"
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;  stripe_count = 1     ;   # linear

    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;  stripes = [
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;     "pv0", 0
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;  ]
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    }
    &nbsp;    &nbsp;    &nbsp; }

    &nbsp;    &nbsp;    &nbsp; lv0_m {
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    id = "scNeN4-4bmg-Y6kq-zKuO-n8B8-s8mw-FTUYqk"
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    status = ["READ", "WRITE", "VISIBLE"]
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    flags = []
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    segment_count = 1

    &nbsp;    &nbsp;    &nbsp;    &nbsp;    segment1 {
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;  start_extent = 0
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;  extent_count = 12800    # 400 Gigabytes

    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;  type = "striped"
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;  stripe_count = 1     ;   # linear

    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;  stripes = [
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;     "pv0", 1280
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;    &nbsp;  ]
    &nbsp;    &nbsp;    &nbsp;    &nbsp;    }
    &nbsp;    &nbsp;    &nbsp; }
    &nbsp;   }
}

Now to extract data with dd, use the below formula (this will only work for linear stripe):

skip=$[extent_size*stripes+pe_start] count=$[extent_size*(extent_count-1)]

So to get the lv0_m data off of the volume:

dd if=/dev/sdb4 of=/opt/bak/lv0_m.iso bs=512 skip=$[65536*1280+384] count=$[65536*(12800-1)] conv=sync,noerror

Once the iso is created, it can then be loop mounted via:

mount -o loop -t ext3 /opt/bak/lv0_m.iso /mnt/lv0_m

You should then be able to see all the files in the mount point which can then be used for data restoration.

Tracking slow running mysql queries

Fri, 03/04/2011 - 18:13 — sandip

First enable logging of slow running queries in "mysqld" section of "my.cnf".

[mysqld]
log_slow_queries=/var/log/mysqld.slow.log
long_query_time=2

Once queries get logged, you can get the top 10 queries sorted by number of occurrences in the log via:

mysqldumpslow -s c -t 10 /var/log/mysqld.slow.log

Dry run update with svn and cvs

Fri, 03/04/2011 - 17:04 — sandip

To test what files would get changed or conflict when running an update:

With svn:

svn merge --dry-run -r BASE:HEAD .

With cvs:

cvs -nq update -d

Remote backups with tar over ssh

Mon, 02/28/2011 - 15:26 — sandip

Below is example of backing up users' home directory to remote host piped via ssh:

tar -cvzf - -C /home {username} | ssh {remotehost} 'cat >/path/to/bak/{username}.tgz'

check webpage load time via wget

Tue, 02/22/2011 - 17:19 — sandip

Here is a simple one liner to check on download time of a webpage:

(time wget -p --no-cache --delete-after www.linuxweblog.com -q ) 2>&1 | awk '/real/ {print $2}'

SSL and subversion client

Mon, 02/07/2011 - 12:03 — sandip

Unlike web browsers, the CA root cert is not installed by default for svn clients. You would need to tell the client where to find it in order to trust the ssl cert.

Reference: svnbook

For GoDaddy signed certs, download their root certs available at:

http://certificates.godaddy.com/repository

You would need both the pem encoded gd-class2-root.crt and gd_intermediate.crt .

Then in subversion client global settings, tell it the path to the certs:

ssl-authority-files = /path/to/gd-class2-root.crt;/path/to/gd_intermediate.crt

This should then trust the ssl cert.

Setup sudo access to mysql user

Sun, 01/30/2011 - 02:13 — sandip

Here is how to give dba user sudo access as mysql user.

visudo and add:

dbauser ALL=(mysql) ALL

Basically, it defines that user "dbauser" can run all commands as "mysql" user.

For the dbauser to get mysql shell, run:

$ sudo -u mysql -i

Comment