Backup Multiple MySQL Or MariaDB Databases Automatically

<div dir="ltr" style="text-align: left;" trbidi="on"> <span style="color: #990000; font-size: large;"><u>Backup Multiple MySQL Or MariaDB Databases Automatically</u></span><br /> <span style="color: #0b5394; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><b><u>Introduction</u></b></span></span><br /> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">In this write-up, we'll walk through how to backup multiple <a href="http://www.hackthesec.co.in/search/label/Mysql">MySQL</a> or <a href="http://www.hackthesec.co.in/search/label/MariaDB">MariaDB </a>databases that sit on the same machine using a custom bash script and setting up a cron job.</span></span><br /> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgO88uCszO-9Zrw3ZVIW1PEmPD6ZihgWILMfBTJtMn1wiCRu8_yiGhcfqtsK2u4jg3I_p2HmYzPpKzF0_p3CEO2-100-5x3FQbKeW9vtauEeE-XP_v2W2rF8DJtchISn2kjVsTI1ZccTN8X/s1600/mariadb_backup_mysql_hackthesec.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgO88uCszO-9Zrw3ZVIW1PEmPD6ZihgWILMfBTJtMn1wiCRu8_yiGhcfqtsK2u4jg3I_p2HmYzPpKzF0_p3CEO2-100-5x3FQbKeW9vtauEeE-XP_v2W2rF8DJtchISn2kjVsTI1ZccTN8X/s1600/mariadb_backup_mysql_hackthesec.jpg" /></a></div> <span style="color: #333333; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><br /></span></span> <span style="color: #0b5394; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><b><u>Database Backup(s)</u></b></span></span><br /> <span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We have three MySQL databases on our linux server named db-hackthesec-site, db-hackthesec-blog, db-hackthesec-app.</span></span><br /> <br /> <span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Log on to your MySQL or MariaDB database and run below query to create a database user <b>db_user_backups</b> to handle backups</span></span><br /> <pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;">GRANT LOCK TABLES, SELECT ON *.*, SHOW VIEW ON *.*, REPLICATION CLIENT ON *.* TO 'db_user_backups'@'%' IDENTIFIED BY '{COMPLEX-PASSWORD}';</span></span></pre> <span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Also run below to make sure MySQL is configured to properly restore stored procedures</span></span><br /> <pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;">SET GLOBAL log_bin_trust_function_creators = 1;</span></span></pre> <span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Setup the necessarily directory structure and files needed</span></span><br /> <pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;"># create backup directory with environment and log file sudo mkdir /backups && cd /backups sudo touch .env db-backup.sh db-backup.log sudo chmod -R 775 /backups sudo chmod -R g+s /backups sudo chmod +x db-backup.sh # add mysql backup user credentials into environment file echo "export MYSQL_USER=db_user_backups" > /backups/.env echo "export MYSQL_PASS={COMPLEX-PASSWORD}" >> /backups/.env</span></span></pre> <span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Open db-backup.sh <b>nano /backups/db-backup.sh</b> and paste the code below inside it, then save the file (Ctrl+X -> Y -> hit Enter).</span></span><br /> <pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;">DB_NAMES=( 'db-hackthesec-site' 'db-</span></span><span style="color: white; font-family: 'Courier New', Courier, monospace; line-height: 15.6px;">hackthesec</span><span style="color: white; font-family: 'Courier New', Courier, monospace; line-height: 15.6px;">-blog' 'db-</span><span style="color: white; font-family: 'Courier New', Courier, monospace; line-height: 15.6px;">hackthesec</span><span style="color: white; font-family: 'Courier New', Courier, monospace; line-height: 15.6px;">-app' ) #replace with your own database name(s)</span> <span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;">BKUP_NAMES=() BKUP_DIR="/backups" # get total number of directories total_dbs=${#DB_NAMES[@]} # create backup file names for (( i=0; i<${total_dbs}; i++ )); do BKUP_NAMES[$i]="`date +%Y%m%d%H%M`-backup-$${DB_NAMES[$i]}.sql.gz" done # get backup users credentials source $BKUP_DIR/.env # create backups for (( i=0; i<${total_dbs}; i++ )); do # NOTE: --routines flag makes sure stored procedures are also backed up mysqldump --routines -u ${MYSQL_USER} -p${MYSQL_PASS} | gzip > ${BKUP_DIR}/${BKUP_NAMES[$i]} done</span></span></pre> <span style="color: #0b5394; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><b><u>Cronjob Setup</u></b></span></span><br /> <span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Setup a cronjob to run every midnight that runs the backup script and saves the result/output to backup log.</span></span><br /> <span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><br /></span></span> <span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Open crontab</span></span><br /> <pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;">crontab -e</span></span></pre> <span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Add below entry to crontab</span></span><br /> <pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;">0 0 * * * /usr/bin/env bash /backups/db-backup.sh &>> /backups/db-backup.log</span></span></pre> <span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Note: While testing you can set cronjob to run every 1 minute instead like below</span></span><br /> <pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;">* * * * * /usr/bin/env bash /backups/db-backup.sh &>> /backups/db-backup.log</span></span></pre> <span style="font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">-OR- every 5 minutes (replace 5 with the number of minutes you want)</span></span><br /> <pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;">*/5 * * * * /usr/bin/env bash /backups/db-backup.sh &>> /backups/db-backup.log</span></span></pre> <pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: Courier New, Courier, monospace;"><span style="line-height: 15.6px;"><a href="http://www.hackthesec.co.in/">www.hackthesec.co.in</a></span></span></pre> </div>

Backup Multiple MySQL Or MariaDB Databases Automatically

Backup Multiple MySQL Or MariaDB Databases Automatically Introduction In this write-up, we'll walk through how to backup multiple MySQL or MariaDB databases that sit on the same machine using a custo…

Read more »

How to Block abusive IP addresses using IPTABLES Firewall in Debian/Ubuntu

<div dir="ltr" style="text-align: left;" trbidi="on"> <h1 class="entry-title" style="background-color: white; box-sizing: border-box; font-family: Lato, sans-serif; line-height: 1.1; margin: 20px 0px 10px;"> <span style="color: #990000; font-size: large;"><u>Blocking abusive IP addresses using IPTABLES Firewall</u></span></h1> <div> <span style="color: #222222; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">In computing, a firewall is a network security system that monitors and controls the incoming and outgoing network traffic based on predetermined security rules. A firewall typically establishes a barrier between a trusted, secure internal network and another outside network, such as the Internet, that is assumed to not be secure or trusted. </span></span></div> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjVLpw76eQcyxf_FJfA5z-xQ_rnjxqJKvLr9bioRWOZ81yGF0gkvnv0ZmEtr_cz0GqKBerizxuLX9yKohg0XrJiIrpt3n3evDA2WOxvLVHWD3uPwxo6i3pImzS__HETrwaS2C9lFrontj46/s1600/firewall_www.hackthesec.co.in.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjVLpw76eQcyxf_FJfA5z-xQ_rnjxqJKvLr9bioRWOZ81yGF0gkvnv0ZmEtr_cz0GqKBerizxuLX9yKohg0XrJiIrpt3n3evDA2WOxvLVHWD3uPwxo6i3pImzS__HETrwaS2C9lFrontj46/s1600/firewall_www.hackthesec.co.in.jpg" /></a></div> <div> <span style="color: #222222; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><br /></span></span></div> <div> <span style="color: #222222; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Firewalls are often categorized as either network firewalls or host-based firewalls. Network firewalls are a software appliance running on general purpose hardware or hardware-based firewall computer appliances that filter traffic between two or more networks. Host-based firewalls provide a layer of software on one host that controls network traffic in and out of that single machine</span></span></div> <div> <div style="font-family: verdana, geneva, sans-serif;"> <ul style="color: #222222; font-size: 15px; line-height: 26px; text-align: left;"> <li>Flushing the old firewall rules</li> <li>Determining service ports</li> <li>Setting-up default policies</li> <li>Setting-up your firewall rules</li> <li>Saving your firewall rules</li> </ul> <div> <div> <span style="font-size: 15px; line-height: 26px;"><b><u><span style="color: #0b5394;">BLOCKING IPs USING IPTABLES</span></u></b></span></div> <div style="color: #222222;"> <span style="font-size: 15px; line-height: 26px;">To block some abusive IP address or range of IPs, you can use the following iptables rules:</span></div> </div> </div> <div> <pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: trebuchet ms, sans-serif;"><span style="font-size: 15px; line-height: 15.6px;">## iptables -I INPUT -s 1.2.3.4 -j DROP ## iptables -I INPUT -s 1.2.0.0/16 -j DROP</span></span></pre> </div> <div> <div> <span style="color: #0b5394; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><b><u>CREATING THE BLACKLIST</u></b></span></span></div> <div> <span style="color: #222222; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">For better readability and maintenance, it is a good idea to have all abusing IPs in one particular file, for example <b>/etc/blacklist.ips</b>. This way, you can add the IP addresses or subnets in this file (one IP or subnet per line) and use the <b>fwall-rules</b> script below to block anything listed in this file.</span></span></div> <div> <span style="color: #222222; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">So, create or edit <b>/usr/local/bin/fwall-rules </b>and make it as follows:</span></span></div> </div> <div style="color: #222222; font-family: verdana, geneva, sans-serif;"> <pre style="background-color: whitesmoke; border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-sizing: border-box; color: #333333; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: 13px; line-height: 1.42857; margin-bottom: 10px; overflow: auto; padding: 9.5px; word-break: break-all; word-wrap: break-word;">#!/bin/bash # # iptables firewall script # # IPTABLES=/sbin/iptables BLACKLIST=/etc/blacklist.ips echo " * flushing old rules" ${IPTABLES} --flush ${IPTABLES} --delete-chain ${IPTABLES} --table nat --flush ${IPTABLES} --table nat --delete-chain echo " * setting default policies" ${IPTABLES} -P INPUT DROP ${IPTABLES} -P FORWARD DROP ${IPTABLES} -P OUTPUT ACCEPT echo " * allowing loopback devices" ${IPTABLES} -A INPUT -i lo -j ACCEPT ${IPTABLES} -A OUTPUT -o lo -j ACCEPT ${IPTABLES} -A INPUT -p tcp ! --syn -m state --state NEW -j DROP ${IPTABLES} -A INPUT -m state --state ESTABLISHED,RELATED -j ACCEPT ## BLOCK ABUSING IPs HERE ## #echo " * BLACKLIST" #${IPTABLES} -A INPUT -s _ABUSIVE_IP_ -j DROP #${IPTABLES} -A INPUT -s _ABUSIVE_IP2_ -j DROP echo " * allowing ssh on port 5622" ${IPTABLES} -A INPUT -p tcp --dport 5622 -m state --state NEW -j ACCEPT echo " * allowing ftp on port 21" ${IPTABLES} -A INPUT -p tcp --dport 21 -m state --state NEW -j ACCEPT echo " * allowing dns on port 53 udp" ${IPTABLES} -A INPUT -p udp -m udp --dport 53 -j ACCEPT echo " * allowing dns on port 53 tcp" ${IPTABLES} -A INPUT -p tcp -m tcp --dport 53 -j ACCEPT echo " * allowing http on port 80" ${IPTABLES} -A INPUT -p tcp --dport 80 -m state --state NEW -j ACCEPT echo " * allowing https on port 443" ${IPTABLES} -A INPUT -p tcp --dport 443 -m state --state NEW -j ACCEPT echo " * allowing smtp on port 25" ${IPTABLES} -A INPUT -p tcp -m state --state NEW -m tcp --dport 25 -j ACCEPT echo " * allowing submission on port 587" ${IPTABLES} -A INPUT -p tcp -m state --state NEW -m tcp --dport 587 -j ACCEPT echo " * allowing imaps on port 993" ${IPTABLES} -A INPUT -p tcp -m state --state NEW -m tcp --dport 993 -j ACCEPT echo " * allowing pop3s on port 995" ${IPTABLES} -A INPUT -p tcp -m state --state NEW -m tcp --dport 995 -j ACCEPT echo " * allowing imap on port 143" ${IPTABLES} -A INPUT -p tcp -m state --state NEW -m tcp --dport 143 -j ACCEPT echo " * allowing pop3 on port 110" ${IPTABLES} -A INPUT -p tcp -m state --state NEW -m tcp --dport 110 -j ACCEPT echo " * allowing ping responses" ${IPTABLES} -A INPUT -p ICMP --icmp-type 8 -j ACCEPT # DROP everything else and Log it ${IPTABLES} -A INPUT -j LOG ${IPTABLES} -A INPUT -j DROP # # Block abusing IPs # from ${BLACKLIST} # if [[ -f "${BLACKLIST}" ]] && [[ -s "${BLACKLIST}" ]]; then echo " * BLOCKING ABUSIVE IPs" while read IP; do ${IPTABLES} -I INPUT -s "${IP}" -j DROP done < <(cat "${BLACKLIST}") fi # # Save settings # echo " * SAVING RULES" if [[ -d /etc/network/if-pre-up.d ]]; then if [[ ! -f /etc/network/if-pre-up.d/iptables ]]; then echo -e "#!/bin/bash" > /etc/network/if-pre-up.d/iptables echo -e "test -e /etc/iptables.rules && iptables-restore -c /etc/iptables.rules" >> /etc/network/if-pre-up.d/iptables chmod +x /etc/network/if-pre-up.d/iptables fi fi iptables-save > /etc/fwall.rules iptables-restore -c /etc/fwall.rules</pre> </div> <div> <span style="color: #222222; font-family: verdana, geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">make sure the script is executable by adding an ‘x’ bit to it:</span></span></div> <div> <pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: trebuchet ms, sans-serif;"><span style="font-size: 15px; line-height: 15.6px;"># chmod +x /usr/local/bin/fwall-rules</span></span></pre> </div> <div style="font-family: verdana, geneva, sans-serif;"> <span style="font-size: 15px; line-height: 26px;"><div> <b><u><span style="color: #0b5394;">APPLYING THE RULES</span></u></b></div> <div style="color: #222222;"> To apply the firewall rules and block the abusers, you need to just execute the fwall-rules script and that’s it.</div> </span></div> <div style="color: #222222; font-family: verdana, geneva, sans-serif;"> <pre style="background-color: whitesmoke; border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-sizing: border-box; color: #333333; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: 13px; line-height: 1.42857; margin-bottom: 10px; overflow: auto; padding: 9.5px; word-break: break-all; word-wrap: break-word;"># fwall-rules * flushing old rules * setting default policies * allowing loopback devices * allowing ssh on port 5622 * allowing ftp on port 21 * allowing dns on port 53 udp * allowing dns on port 53 tcp * allowing http on port 80 * allowing https on port 443 * allowing smtp on port 25 * allowing submission on port 587 * allowing imaps on port 993 * allowing pop3s on port 995 * allowing imap on port 143 * allowing pop3 on port 110 * allowing ping responses * BLOCKING ABUSIVE IPs * SAVING RULES</pre> <pre style="background-color: whitesmoke; border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-sizing: border-box; color: #333333; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: 13px; line-height: 1.42857; margin-bottom: 10px; overflow: auto; padding: 9.5px; word-break: break-all; word-wrap: break-word;"><a href="http://wwww.hackthesec.co.in/">wwww.hackthesec.co.in</a> </pre> </div> </div> </div>

How to Block abusive IP addresses using IPTABLES Firewall in Debian/Ubuntu

Blocking abusive IP addresses using IPTABLES Firewall In computing, a firewall is a network security system that monitors and controls the incoming and outgoing network traffic based on predetermined…

Read more »

Linux – Top memory usage by process

<div dir="ltr" style="text-align: left;" trbidi="on"> <h1 class="entry-title" style="background-color: white; clear: both; color: #333333; font-family: 'Helvetica Neue', Helvetica, Arial, sans-serif; line-height: 40px; margin: 10px 0px; text-rendering: optimizeLegibility;"> <span style="font-size: x-large;"><u>Linux – Top memory usage by process</u></span></h1> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Here are a couple of commands to help find top memory wasters</span></span><span style="background-color: white; color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;">.</span></div> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg_Ogf5PmKNi9d9wfqxdw6uOec_fxPD_AsnOZvk2aplKfm27QjBNpGmRUwliyQt0qN0rGSZbGwsQPI3m27mcWp7A9yoWoM7-fj2bmOuOYKSbhoJ2xevlF2Fp_PMzFxgA9GC1CPDKOgJRMDL/s1600/memory-utilization-monitoring-www.hackthesec.co.in.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg_Ogf5PmKNi9d9wfqxdw6uOec_fxPD_AsnOZvk2aplKfm27QjBNpGmRUwliyQt0qN0rGSZbGwsQPI3m27mcWp7A9yoWoM7-fj2bmOuOYKSbhoJ2xevlF2Fp_PMzFxgA9GC1CPDKOgJRMDL/s1600/memory-utilization-monitoring-www.hackthesec.co.in.png" /></a></div> <div> <span style="background-color: white; color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;"><br /></span></div> <div> <span style="background-color: white;"><div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;"> <b><u>Process – Sorted by occupied memory(2 column)1</u></b></div> <div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;"> <pre style="background-color: whitesmoke; border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-sizing: border-box; color: #333333; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: 14px; line-height: 1.42857; margin-bottom: 10.5px; overflow: auto; padding: 10px; word-break: break-all; word-wrap: break-word;"><code style="background-color: transparent; border-radius: 0px; box-sizing: border-box; color: inherit; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: inherit; padding: 0px; white-space: pre-wrap;">ps -e -orss=,pid=,args= | sort -nr | head|awk '{print $2"\t"$1/1024"\tMB\t"$3;}'</code></pre> </div> <div style="color: #222222; font-family: Verdana, Geneva, sans-serif;"> <span style="font-size: 15px; line-height: 26px;"><b><u>Method 2</u></b></span></div> <div> <div> <pre style="background-color: whitesmoke; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-sizing: border-box; margin-bottom: 10.5px; overflow: auto; padding: 10px; word-break: break-all; word-wrap: break-word;"><span style="color: #333333; font-family: Menlo, Monaco, Consolas, Courier New, monospace;"><span style="font-size: 14px; line-height: 20px; white-space: pre-wrap;">cat /proc/meminfo |grep MemTotal echo ' ' | awk '{ system("cat /proc/meminfo |grep MemTotal") }'</span></span></pre> <pre style="background-color: whitesmoke; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-sizing: border-box; margin-bottom: 10.5px; overflow: auto; padding: 10px; word-break: break-all; word-wrap: break-word;"><span style="color: #333333; font-family: Menlo, Monaco, Consolas, Courier New, monospace;"><span style="font-size: 14px; line-height: 20px; white-space: pre-wrap;">totalmem=$(cat /proc/meminfo |grep MemTotal | awk '{print $2}'); ps -e -orss=,pid=,args= | sort -nr | head|awk '{print $2"\t"$1/1024"\t"$3"\t"$totalmem;}'</span></span></pre> </div> </div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><b><u>Disk Usage</u></b></span></span></div> <div> <div> <pre style="background-color: whitesmoke; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-sizing: border-box; margin-bottom: 10.5px; overflow: auto; padding: 10px; word-break: break-all; word-wrap: break-word;"><span style="color: #333333; font-family: Menlo, Monaco, Consolas, Courier New, monospace;"><span style="font-size: 14px; line-height: 20px; white-space: pre-wrap;">sudo du -hx --max-depth=2 / |egrep "^[0-9\.]+G" # show home directory echo ' ' | awk '{ system("ls -la ~") }'</span></span></pre> </div> </div> <div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;"> <a href="http://www.hackthesec.co.in/">www.hackthesec.co.in</a></div> </span></div> </div>

Linux – Top memory usage by process

Linux – Top memory usage by process Here are a couple of commands to help find top memory wasters. Process – Sorted by occupied memory(2 column)1 ps -e -orss=,pid=,args= | sort -nr | head|awk '{print…

Read more »

Rsync-Automatic Backup Script

<div dir="ltr" style="text-align: left;" trbidi="on"> <span style="font-size: x-large;"><b><u>Rsync-Backup Script</u></b></span><br /> <div style="background-color: white; text-align: justify;"> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">rsync is a widely-used utility to keep copies of a file on two computer systems the same. It is commonly found on Unix-like systems and functions as both a file synchronization and file transfer program. The rsync algorithm, a type of delta encoding, is used to minimize network usage. Zlib may be used for additional compression, and <a href="http://www.hackthesec.co.in/search/label/SSH">SSH </a>or stunnel can be used for data security.</span></span></div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><br /></span></span></div> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEifikxORTcCWGEKUMGs1B6qcE1FGZYXx-mprnhY8QwnPw9dNKSTaGTZZPm_lirxHa8AENfuM2DO4WARHmwYpEE7R1Od8Eax49M_8FbrwO6iCOKtZ3y7Fjy213cJsCYpHW5hV-h17xVcTzx-/s1600/Rsync-data-backup-www.hackthesec.co.in.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEifikxORTcCWGEKUMGs1B6qcE1FGZYXx-mprnhY8QwnPw9dNKSTaGTZZPm_lirxHa8AENfuM2DO4WARHmwYpEE7R1Od8Eax49M_8FbrwO6iCOKtZ3y7Fjy213cJsCYpHW5hV-h17xVcTzx-/s1600/Rsync-data-backup-www.hackthesec.co.in.jpg" /></a></div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Rsync is typically used to synchronize files and directories between two different systems. For example, if the command rsync local-file user@remote-host:remote-file is run, rsync will use SSH to connect as user to remote-host. Once connected, it will invoke the remote host's rsync and then the two programs will determine what parts of the file need to be transferred over the connection.</span></span></div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><br /></span></span></div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Rsync can also operate in a daemon mode, serving files in the native rsync protocol (using the "<a href="http://www.hackthesec.co.in/search/label/rsync">rsync</a>://" syntax).</span></span></div> </div> <div style="text-align: center;"> <span style="font-size: x-large;"><b><u><a href="http://hackthesec.byethost22.com/rsync-backup.sh">DOWNLOAD HERE</a></u></b></span></div> </div>

Rsync-Automatic Backup Script

Rsync-Backup Script rsync is a widely-used utility to keep copies of a file on two computer systems the same. It is commonly found on Unix-like systems and functions as both a file synchronization an…

Read more »

How To Create An Off-Site Backup Of Your Site With Rsync On Centos 6

<div dir="ltr" style="text-align: left;" trbidi="on"> <h1 class="content-title" style="background-color: white; font-family: proxima-nova, sans-serif; line-height: 1.2; margin: 0px 0px 10px; padding: 0px;"> <span style="color: #660000; font-size: large;"><u>Backup Of Your Site With Rsync On Centos 6</u></span></h1> <div style="text-align: justify;"> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">There are two ways to do backup: incremental and full backups. A full backup copies all the data, while the snapshot only handles the changes since the last update.</span></span></div> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjP9lXyRenQunM7aWiKUiXHl0FBxPohZxc_B_trNi76iWAL_-5AaQajlHiEon2jz7pqgqVrG_BEny7WyNf_DJ6xdzNTUqJtnfByFL4haI9FhU-wwDRDuHMVw4QNmbsRbk2qXLPWumdjmnj-/s1600/Rsync-data-backup-www.hackthesec.co.in.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjP9lXyRenQunM7aWiKUiXHl0FBxPohZxc_B_trNi76iWAL_-5AaQajlHiEon2jz7pqgqVrG_BEny7WyNf_DJ6xdzNTUqJtnfByFL4haI9FhU-wwDRDuHMVw4QNmbsRbk2qXLPWumdjmnj-/s1600/Rsync-data-backup-www.hackthesec.co.in.jpg" /></a></div> <div style="text-align: justify;"> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"><br /></span></span></div> <div style="text-align: justify;"> <div style="color: #222222; font-family: Verdana, Geneva, sans-serif; line-height: 26px;"> <b><u><span style="font-size: large;">Full Backup</span></u></b></div> <div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;"> Full backup typically does the following:</div> <div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;"> <ul> <li>Make an archive of all the files in a folder</li> <li>Copy the resulting archive to a remote server.</li> </ul> </div> <div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;"> As noted, our data will reside in /var/www/wordpress directory. We will designate a backup folder location.</div> <div> <pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;"><span style="color: white;"># </span></span><span style="background-color: transparent; color: white; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;">mkdir -p /backup/wordpress</span></pre> </div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">The above command will create a /backup directory, and a /backup/wordpress directory, if they do not exist. To create a full snapshot of our data, we use the linux tool called tar.</span></span></div> <div> <pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><div style="text-align: justify;"> <span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">tar -czf /backup/wordpress/initial_backup.tar.gz </span></span><span style="background-color: transparent; color: white; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;">/var/www/wordpress</span></div> </pre> </div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Tar will create a gzip archive in a file initial_backup.tar.gz. We could add a v flag (so we get tar -czvf) if we want a verbose output (list of filenames). We name the file initial_backup.tar.gz so that we know that this is an initial backup, it is archived with tar and iz is zipped in a gzip format. Tar will use whatever arguments we provide as a source, in our case it will backup /var/www/wordpress directory. We could pass two or more arguments, whether they be files or folders: ie.</span></span></div> <div> <pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><div style="text-align: justify;"> <span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;"><span style="color: white;"># </span></span><span style="line-height: 15.6px; text-align: left;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">tar -czf /backup/cms_systems_backup.tar.gz /var/www/wordpress </span></span><span style="color: white; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;">/var/www/drupal /var/www/joomla</span></div> </pre> </div> <div> <div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;"> The last command would backup all of our installed cms systems.</div> <div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;"> Now, for our future backups, we may want to add a date when the backup was taken:</div> <div> <div> <pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><div style="text-align: left;"> <span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;"><span style="color: white;"># </span></span><span style="line-height: 15.6px; text-align: left;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">tar -czf /backup/wordpress/wordpress-`date '+%m%d%y'`.tar.gz </span></span><span style="color: white; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;">/var/www/wordpress</span></div> </pre> </div> <div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;"> </div> </div> </div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Lets' see what we have now:</span></span></div> <div> <div> <pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ls -l /backup/wordpress/ <div style="text-align: left;"> <span style="background-color: transparent;">-rw-r--r-- 1 root root 4995743 Mar 4 12:16 initial_backup.tar.gz</span></div> total 9760 <div style="text-align: left;"> <span style="background-color: transparent;">-rw-r--r-- 1 root root 4995743 Mar 4 12:25 wordpress-041713.tar.gz</span></div> </span></span></pre> </div> <div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;"> </div> </div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Now, to schedule this daily, we need to create a crontab entry. Crontab is a linux task scheduler: we tell it when to do something and what task to actually do. Anyway, we open up the crontab editor:</span></span></div> <div> <pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;"><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; line-height: 15.6px;"><span style="color: white;"># </span></span></span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">crontab -e</span></span></pre> <div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Now we need to tell cron to backup, say, every day at 3.30am, when there is hopefully not a lot of traffic. We will also tell it to email us any findings. We put this content into crontab:</span></span></div> <div> <pre class="xtypo_info" style="background: url("assets/shadow.png") 50% 100% repeat-x rgb(245, 245, 245); border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-shadow: rgb(204, 204, 204) 0px 0px 3px; box-sizing: border-box; color: #333333; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: 13px; font-stretch: normal; line-height: 1.42857; margin-bottom: 10px; overflow: auto; padding: 9.5px; tab-size: 4; text-align: left; text-shadow: rgb(255, 255, 255) 0px 1px 0px; white-space: pre-wrap; word-break: break-all; word-wrap: break-word;">MAILTO=email@example.com 30 3 * * * /bin/tar -czf /backup/wordpress/wordpress-`date +\%m\%d\%y`.tar.gz /var/www/wordpress</pre> </div> <div> <div> </div> </div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We save the file with CTRL-X and confirm with Y and Enter. The above command will tell linux to repeat our command every day at 3:30. We also told cron to email us with the results. </span></span></div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: large;"><span style="line-height: 26px;"><b><u>Copy the Backups to Another Remote Server</u></b></span></span></div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">To copy the backups to another remote server, we will use scp - secure copy. First, we need to generate an SSH key:</span></span></div> <div> <pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;"><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; line-height: 15.6px;"><span style="color: white;"># </span></span></span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh-keygen</span></span></pre> <div> </div> </div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We can leave the passphrase empty for now, and use the /root/.ssh/id_rsa_backup key file (or /home/username/.ssh/id_rsa_backup if we're not running as root). Now we can check the public key part:</span></span></div> <div> <pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;"><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; line-height: 15.6px;"><span style="color: white;"># </span></span></span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">cat .ssh/id_rsa_backup.pub</span></span></pre> </div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We need to copy this public part of SSH key to the remote server, to a file authorized_keys. I assume we already have a remote server called backup.example.com and a user backup.</span></span></div> <div> <div> <pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;"><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; line-height: 15.6px;"><span style="color: white;"># </span></span></span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">scp .ssh/id_rsa_backup.pub backup@backup.example.com:/home/backup/backup_key.pub</span></span></pre> </div> </div> <div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We'll be prompted for the backup users' password. We copied the file, now let's add it where it should be, in authorized_keys. I cannot assume that this user already has the file and folder set up, so lets check that info:</span></span></div> <div> <pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;"><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="color: #333333; line-height: 19.2px;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; line-height: 15.6px;"><span style="color: white;"># </span></span></span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh backup@backup.example.com "mkdir -p /home/backup/.ssh" </span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh backup@backup.example.com "chmod 700 /home/backup/.ssh" </span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh backup@backup.example.com "touch /home/backup/.ssh/authorized_keys" </span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh backup@backup.example.com "chmod 600 /home/backup/.ssh/authorized_keys" </span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh backup@backup.example.com "mkdir -p /home/backup/backups"</span></span><span style="background-color: transparent; font-size: 15px; line-height: 26px; text-align: justify; white-space: normal;"><span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"> </span></span></pre> </div> <div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">The few commands above created a directory for SSH to work with, if it didn't exist, and also the authorized_keys file, which needs to be present for backups to work. We also created a backups directory to store our files to. Now what is left is to copy our public key to that file.</span></span></div> <div> <div> <pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh backup@backup.example.com "cat /home/backup/backup_key.pub >> /home/backup/.ssh/authorized_keys"</span></span></pre> </div> <div> </div> </div> <div> </div> </div> </div> <div> <div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;"> Now we can use this key to copy stuff in the future.</div> <div style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: 15px; line-height: 26px;"> Now, let's copy the backup file over there:</div> <div> <div> <div> <div> <pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">scp -i .ssh/id_rsa_backup /backup/wordpress/wordpress-041713.tar.gz backup@backup.example.com:/home/backup/backups</span></span></pre> </div> <div style="color: black; font-family: 'Times New Roman'; font-size: medium; line-height: normal;"> </div> </div> <div style="color: black; font-family: 'Times New Roman'; font-size: medium; line-height: normal;"> </div> </div> <div style="color: black; font-family: 'Times New Roman'; font-size: medium; line-height: normal;"> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;"></span></span></div> </div> </div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">If our key setup was correct, the file will be copied and we won't be asked for passwords. We can check that the file is really there:</span></span></div> <div> <pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh backup@backup.example.com "ls -l /home/backup/backups"</span></span><span style="background-color: transparent; font-size: 15px; line-height: 26px; text-align: justify; white-space: normal;"><span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"> </span></span></pre> </div> <div> <div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Ok, we can now schedule this action to the crontab too. Start the crontab editor again:</span></span></div> </div> <div> <div> <pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">crontab -e</span></span></pre> </div> <div> <div> </div> </div> </div> <div> </div> </div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We will now alter our backup line: we want to add info to copy our backup archive when it's created. So, we append the new command so that it looks like this:</span></span></div> <div> <pre class="xtypo_info" style="background: url("assets/shadow.png") 50% 100% repeat-x rgb(245, 245, 245); border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-shadow: rgb(204, 204, 204) 0px 0px 3px; box-sizing: border-box; color: #333333; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: 13px; font-stretch: normal; line-height: 1.42857; margin-bottom: 10px; overflow: auto; padding: 9.5px; tab-size: 4; text-align: left; text-shadow: rgb(255, 255, 255) 0px 1px 0px; white-space: pre-wrap; word-break: break-all; word-wrap: break-word;">30 3 * * * /bin/tar -czf /backup/wordpress/wordpress-`date +\%m\%d\%y`.tar.gz /var/www/wordpress;/usr/bin/scp -i /root/.ssh/id_rsa_backup /backup/wordpress/wordpress-`date +\%m\%d\%y`.tar.gz backup@backup.example.com:/home/backup/backups</pre> </div> <div> <div> <div> <div> </div> </div> </div> <div> </div> </div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: large;"><span style="line-height: 26px;"><b><u>Incremental Backup</u></b></span></span></div> <div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">But what if we have our own backup software at another server? We just want to synchronize the data over, and then leave the other server to do the backup work. In addition, we want to preserve file stamps. Then we use rsync. The use case here is that we want to just incrementally copy over everything from /var/www/wordpress to a remote server, this time to a /home/backup/snapshots/wordpress directory. Here is a simple command to do all that:</span></span></div> </div> <div> <div> <div> <div> <pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">ssh backup@backup.example.com "mkdir -p /home/backup/sync" rsync -avz --delete -e "ssh -i /root/.ssh/id_rsa_backup" /var/www/wordpress backup@backup.example.com:/home/backup/sync</span></span></pre> </div> <div> <div> </div> </div> </div> <div> </div> </div> </div> <div> </div> </div> </div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">The first line creates a snapshot directory and the second copies the changed files over. That means the files that were modified, newly created or deleted. We can schedule it in cron too:</span></span></div> <div> <div> <div> <div> <div> <pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">crontab -e</span></span></pre> </div> <div> <div> </div> </div> </div> <div> </div> </div> <div> </div> </div> </div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">The crontab line should look like this:</span></span></div> <div> <pre class="xtypo_info" style="background: url("assets/shadow.png") 50% 100% repeat-x rgb(245, 245, 245); border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-shadow: rgb(204, 204, 204) 0px 0px 3px; box-sizing: border-box; color: #333333; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: 13px; font-stretch: normal; line-height: 1.42857; margin-bottom: 10px; overflow: auto; padding: 9.5px; tab-size: 4; text-align: left; text-shadow: rgb(255, 255, 255) 0px 1px 0px; white-space: pre-wrap; word-break: break-all; word-wrap: break-word;">30 3 * * * /usr/bin/rsync -avz --delete -e "ssh -i /root/.ssh/id_rsa_backup" /var/www/wordpress backup@backup.example.com:/home/backup/sync</pre> </div> <div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif; font-size: large;"><span style="line-height: 26px;"><b><u>Backup Database</u></b></span></span></div> <div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">We can also backup our database. First, we want to dump the data. If we followed the wordpress install guide, we also have a database wordpress, accessed by user wordpressuser with password password. We can do the initial dump like this:</span></span></div> <div> <div> <div> <div> <div> <pre style="background-attachment: scroll; background-clip: initial; background-color: #3c3c3c; background-image: none; background-origin: initial; background-position: 0px 0px; background-repeat: repeat; background-size: initial; border-image-outset: initial; border-image-repeat: initial; border-image-slice: initial; border-image-source: initial; border-image-width: initial; border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; text-align: left; vertical-align: baseline;"><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">[root@hackthesec </span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 19.2px; text-align: justify;"><span style="background-color: transparent; line-height: 15.6px;"><span style="color: white;">/]</span></span></span><span style="background-color: transparent; color: #333333; font-family: 'Courier New', Courier, monospace; font-size: medium; line-height: 15.6px; text-align: justify;"><span style="color: white;"># </span></span><span style="background-color: transparent; line-height: 15.6px; text-align: justify;"><span style="color: white; font-family: Courier New, Courier, monospace; font-size: medium;">mkdir /backup/mysql mysqldump < wordpress -u wordpressuser -ppassword | gzip > /backup/mysql/initial.sql.gz</span></span></pre> </div> <div> <div> </div> </div> </div> <div> </div> </div> <div> </div> </div> </div> <div> </div> </div> <div style="color: black; font-family: 'Times New Roman'; font-size: medium; line-height: normal;"> </div> </div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">This command created a initial.sql.gz gziped SQL file. To do it on a daily basis, we can schedule it in cron, like before. Our resulting cron line should look like this:</span></span></div> <div> <div> <pre class="xtypo_info" style="background: url("assets/shadow.png") 50% 100% repeat-x rgb(245, 245, 245); border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-shadow: rgb(204, 204, 204) 0px 0px 3px; box-sizing: border-box; color: #333333; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: 13px; font-stretch: normal; line-height: 1.42857; margin-bottom: 10px; overflow: auto; padding: 9.5px; tab-size: 4; text-align: left; text-shadow: rgb(255, 255, 255) 0px 1px 0px; white-space: pre-wrap; word-break: break-all; word-wrap: break-word;">0 4 * * * /usr/bin/mysqldump < wordpress -u wordpressuser -ppassword | /bin/gzip > /backup/mysql/mysql--`date +\%m\%d\%y`.sql.gz</pre> </div> <div> </div> </div> <div> <span style="color: #222222; font-family: Verdana, Geneva, sans-serif;"><span style="font-size: 15px; line-height: 26px;">Now we could also combine it with scp or rsync to copy it remotely.</span></span></div> <div> <pre class="xtypo_info" style="background: url("assets/shadow.png") 50% 100% repeat-x rgb(245, 245, 245); border-radius: 4px; border: 1px solid rgb(204, 204, 204); box-shadow: rgb(204, 204, 204) 0px 0px 3px; box-sizing: border-box; color: #333333; font-family: Menlo, Monaco, Consolas, 'Courier New', monospace; font-size: 13px; font-stretch: normal; line-height: 1.42857; margin-bottom: 10px; overflow: auto; padding: 9.5px; tab-size: 4; text-align: left; text-shadow: rgb(255, 255, 255) 0px 1px 0px; white-space: pre-wrap; word-break: break-all; word-wrap: break-word;">0 4 * * * /usr/bin/mysqldump < wordpress -u wordpressuser -ppassword | /bin/gzip > /backup/mysql/mysql-`date +\%m\%d\%y`.sql.gz; /usr/bin/scp -i /root/.ssh/id_rsa_backup /backup/mysql/mysql-`date +\%m\%d\%y`.sql.gz backup@backup.example.com:/home/backup/ </pre> </div> <div> <a href="http://www.hackthesec.co.in/">HACKTHESEC.CO.IN</a></div> </div> </div>

How To Create An Off-Site Backup Of Your Site With Rsync On Centos 6

Backup Of Your Site With Rsync On Centos 6 There are two ways to do backup: incremental and full backups. A full backup copies all the data, while the snapshot only handles the changes since the last…

Read more »

Send Email Alert When Hardware Errors Detected

<div dir="ltr" style="text-align: left;" trbidi="on"> <div style="margin-bottom: 0in;"> <span style="color: red; font-size: large;"><i style="color: red; font-weight: bold; text-decoration: underline;">Send Email Alert When Hardware Errors Detected</i></span></div> <div style="margin-bottom: 0in;"> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgtAmpCzzGIBWU_apJYj-213hyphenhyphensUMg2Ps59KWup0n4uaRzJZmA41rG4KOKjsTS3UwyTkbKfglRLY1t6HnA9Nj9QqmlS_MOdbdq2Mnt-hfVf9-K_zHTPkQOb_vi0EPBrv2KvwoxJjv_mo-5Z/s1600/hardware-bug-www.hackthesec.co.in.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgtAmpCzzGIBWU_apJYj-213hyphenhyphensUMg2Ps59KWup0n4uaRzJZmA41rG4KOKjsTS3UwyTkbKfglRLY1t6HnA9Nj9QqmlS_MOdbdq2Mnt-hfVf9-K_zHTPkQOb_vi0EPBrv2KvwoxJjv_mo-5Z/s1600/hardware-bug-www.hackthesec.co.in.jpg" /></a></div> <span style="color: red; font-size: large;"><u><b><i><br /></i></b></u></span></div> <pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: lime; font-size: medium;"><span style="line-height: 15.6px;">[root@instructor script]# yum install mcelog -y</span></span></pre> <div style="margin-bottom: 0in;"> <span style="font-size: large;">Default Mcelog cron file is here</span><span style="color: red; font-size: large;"> /etc/cron.hourly/mcelog.cron</span></div> <pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: lime; font-size: medium;"><span style="line-height: 15.6px;">[root@instructor script]# vi /etc/cron.hourly/mcelog.cron #!/bin/bash # do not run if mcelogd is running service mcelogd status >& /dev/null [ $? -eq 0 ] && exit 0 # is mcelog supported? /usr/sbin/mcelog --supported >& /dev/null if [ $? -eq 1 ]; then exit 1; fi /usr/sbin/mcelog --ignorenodev --filter >> /var/log/mcelog </span></span></pre> <div> <span style="line-height: 15.6px;"><b><span style="font-family: "georgia" , "times new roman" , serif; font-size: large;"><br /></span></b></span></div> <div style="margin-bottom: 0in;"> <span style="font-family: "georgia" , "times new roman" , serif; font-size: large;">After that paste bellow line into you <b>hardwareerror.sh</b> file.. </span></div> <pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: lime; font-size: medium;"><span style="line-height: 15.6px;">[root@instructor script]# touch hardwareerror.sh </span></span></pre> <pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: lime; font-size: medium;"><span style="line-height: 15.6px;">[root@instructor script]# vi hardwareerror.sh #!/bin/bash [ $(grep -c "error" /var/log/mcelog) -gt 0 ] && echo "Hardware Error Found $(hostname) @ $(date)" | cat /var/log/mcelog | mail -s 'H/w Error' info@hackthesec.co.in exit 0 </span></span></pre> <div style="margin-bottom: 0in;"> <span style="color: red;"><span style="font-family: Georgia, Times New Roman, serif; font-size: large;">and run the script through cronjob<br /></span><span style="color: red;">Note : - If your system get any hardware issue then the script will send you a mail other wise you did </span></span></div> <div style="margin-bottom: 0in;"> <span style="color: red;"></span></div> <div style="margin-bottom: 0in;"> <span style="color: red;">not get any email... *Only when your system detected any issue*</span></div> <div style="margin-bottom: 0in;"> <br /></div> <div style="margin-bottom: 0in;"> <a href="http://www.hackthesec.co.in/" target="_blank">www.hackthesec.co.in</a><br /><a href="http://www.twitter.com/hackthesecurity">www.twitter.com/hackthesecurity</a><br /><a href="http://www.hackthesec.co.in/p/about-us.html">http://www.hackthesec.co.in/p/about-us.html</a></div> </div>

Send Email Alert When Hardware Errors Detected

Send Email Alert When Hardware Errors Detected [root@instructor script]# yum install mcelog -y Default Mcelog cron file is here /etc/cron.hourly/mcelog.cron [root@instructor script]# vi /etc/cron.hou…

Read more »

Shell Script : Find All Zip / Rar Files Then Unzip / Unrar

<div dir="ltr" style="text-align: left;" trbidi="on"> <h1 class="post-title single" style="background-color: white; font-family: Arial, Helvetica, sans-serif; font-size: 20pt; letter-spacing: -1px; line-height: 1.2em; margin: 0px 0px 5px; padding: 0px;"> <u><span style="color: red;"><i>Find All Zip / Rar Files Then Unzip / Unrar</i></span></u></h1> <div class="separator" style="clear: both; text-align: center;"> <a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhQ2QAVsVYa3aUSJrMqy8js6qDvn05hXJDd3yUc-3zVcFenQAx1Be5R1NmWSVvFKsmjZ8VWZ-XwZUPWEmwgVACcmcCJNHK3ZhXPi3EnBr-wltfuCL815oqlDSVIhKcIDIkZa2oPSiqk-f_e/s1600/shellscripting_www.hackthesec.co.in.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="197" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhQ2QAVsVYa3aUSJrMqy8js6qDvn05hXJDd3yUc-3zVcFenQAx1Be5R1NmWSVvFKsmjZ8VWZ-XwZUPWEmwgVACcmcCJNHK3ZhXPi3EnBr-wltfuCL815oqlDSVIhKcIDIkZa2oPSiqk-f_e/s320/shellscripting_www.hackthesec.co.in.jpg" width="320" /></a></div> <div class="separator" style="clear: both; text-align: center;"> <br /></div> <div class="separator" style="clear: both; text-align: left;"> <span style="background-color: white; color: #272727; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; line-height: 28.8px;">We must first install and enable </span><span style="background-color: white; border: 0px; color: #333333; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; font-stretch: inherit; line-height: 28.8px; margin: 0px; padding: 0px; vertical-align: baseline;">RPMForge</span><span style="background-color: white; color: #272727; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; line-height: 28.8px;"> repository under Linux systems to install </span><span style="background-color: white; border: 0px; color: #333333; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; font-stretch: inherit; line-height: 28.8px; margin: 0px; padding: 0px; vertical-align: baseline;">Unrar</span><span style="background-color: white; color: #272727; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; line-height: 28.8px;"> and </span><span style="background-color: white; border: 0px; color: #333333; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; font-stretch: inherit; line-height: 28.8px; margin: 0px; padding: 0px; vertical-align: baseline;">Rar</span><span style="background-color: white; color: #272727; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; line-height: 28.8px;"> command-line applications. We have provided </span><span style="background-color: white; border: 0px; color: #333333; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; font-stretch: inherit; line-height: 28.8px; margin: 0px; padding: 0px; vertical-align: baseline;">RPMForge</span><span style="background-color: white; color: #272727; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; line-height: 28.8px;"> repositories for </span><span style="background-color: white; border: 0px; color: #cc0000; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; font-stretch: inherit; line-height: 28.8px; margin: 0px; padding: 0px; vertical-align: baseline;"><a href="http://www.hackthesec.co.in/search/label/RHEL" target="_blank">RHEL</a></span><span style="background-color: white; color: #272727; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; line-height: 28.8px;">/</span><a href="http://www.hackthesec.co.in/search/label/Centos" target="_blank"><span style="background-color: white; border: 0px; color: #990099; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; font-stretch: inherit; line-height: 28.8px; margin: 0px; padding: 0px; vertical-align: baseline;">CentOS</span><span style="background-color: white; color: #272727; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; line-height: 28.8px;"> </span></a><span style="background-color: white; border: 0px; color: #333333; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; font-stretch: inherit; line-height: 28.8px; margin: 0px; padding: 0px; vertical-align: baseline;">6/5/4</span><span style="background-color: white; color: #272727; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; line-height: 28.8px;"> distributions. By default</span><span style="background-color: white; border: 0px; color: #333333; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; font-stretch: inherit; line-height: 28.8px; margin: 0px; padding: 0px; vertical-align: baseline;">RPMForge</span><span style="background-color: white; color: #272727; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; line-height: 28.8px;"> repository already shipped with </span><span style="background-color: white; border: 0px; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; font-stretch: inherit; line-height: 28.8px; margin: 0px; padding: 0px; vertical-align: baseline;">Fedora 17-12</span><span style="background-color: white; color: #272727; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; line-height: 28.8px;"> systems, So fedora user’s don’t need to install it again</span></div> <div class="separator" style="clear: both; text-align: left;"> <span style="background-color: white; color: #272727; font-family: "roboto condensed" , "arial" , sans-serif; font-size: 18px; line-height: 28.8px;"><br /></span></div> <h5 style="background-color: white; border-bottom-color: rgb(221, 221, 221); border-bottom-style: dashed; border-width: 0px 0px 1px; color: #444444; font-family: 'Roboto Condensed', Arial, sans-serif; font-size: 22px; font-stretch: inherit; font-weight: 400; line-height: 1.3em; margin: 0px 0px 14px; padding: 0px; vertical-align: baseline; word-wrap: break-word;"> For RHEL/CentOS 6/5/4 – 32-Bit OS</h5> <div> <pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="font-family: "courier new" , "courier" , monospace; font-size: medium;"><span style="line-height: 15.6px;"><b style="color: white;">## RHEL/CentOS 6 32-Bit ## </b><span style="color: orange;"># wget http://pkgs.repoforge.org/rpmforge-release/rpmforge-release-0.5.2-2.el6.rf.i686.rpm </span><span style="color: lime;"># rpm -Uvh rpmforge-release-0.5.2-2.el6.rf.i686.rpm </span><span style="color: white;"> </span><b style="color: white;">## RHEL/CentOS 5 32-Bit ##</b><span style="color: white;"> </span><span style="color: orange;"># wget http://pkgs.repoforge.org/rpmforge-release/rpmforge-release-0.5.2-2.el5.rf.i386.rpm </span><span style="color: lime;"># rpm -Uvh rpmforge-release-0.5.2-2.el5.rf.i386.rpm </span><span style="color: white;"> </span><b style="color: white;">## RHEL/CentOS 4 32-Bit ## </b><span style="color: orange;"># wget http://pkgs.repoforge.org/rpmforge-release/rpmforge-release-0.5.2-1.el4.rf.i386.rpm </span><span style="color: lime;"># rpm -Uvh rpmforge-release-0.5.2-1.el4.rf.i386.rpm</span></span></span></pre> </div> <div> <h5 style="background-color: white; border-bottom-color: rgb(221, 221, 221); border-bottom-style: dashed; border-width: 0px 0px 1px; color: #444444; font-family: 'Roboto Condensed', Arial, sans-serif; font-size: 22px; font-stretch: inherit; font-weight: 400; line-height: 1.3em; margin: 0px 0px 14px; padding: 0px; vertical-align: baseline; word-wrap: break-word;"> For RHEL/CentOS 6/5/4 – 64-Bit OS</h5> </div> <div> <pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="font-family: "courier new" , "courier" , monospace; font-size: medium;"><span style="line-height: 15.6px;"><b style="color: white;">## RHEL/CentOS 6 64-Bit ## </b><span style="color: orange;"># wget http://pkgs.repoforge.org/rpmforge-release/rpmforge-release-0.5.2-2.el6.rf.x86_64.rpm </span><span style="color: lime;"># rpm -Uvh rpmforge-release-0.5.2-2.el6.rf.x86_64.rpm </span><span style="color: white;"> </span><b style="color: white;">## RHEL/CentOS 5 64-Bit ## </b><span style="color: orange;"># wget http://pkgs.repoforge.org/rpmforge-release/rpmforge-release-0.5.2-2.el5.rf.x86_64.rpm </span><span style="color: lime;"># rpm -Uvh rpmforge-release-0.5.2-2.el5.rf.x86_64.rpm </span><span style="color: white;"> </span><b style="color: white;">## RHEL/CentOS 4 64-Bit ## </b><span style="color: orange;"># wget http://pkgs.repoforge.org/rpmforge-release/rpmforge-release-0.5.2-2.el4.rf.x86_64.rpm </span><span style="color: lime;"># rpm -Uvh rpmforge-release-0.5.2-2.el4.rf.x86_64.rpm</span></span></span></pre> </div> <div> <h3 style="background-color: white; border: 0px; margin: 0px 0px 15px; padding: 0px;"> <span style="font-size: large;"><span style="font-family: "arial" , "helvetica" , sans-serif;"><span style="letter-spacing: -1px; line-height: 1.2em;"><span style="color: red;">Note: - For unrar command you have to install the command like this - </span><span style="color: #0b5394;">yum install unrar</span><span style="color: red;"> for centos/REDHAT and FOR Ubuntu Debian - </span></span><span style="letter-spacing: -1px; line-height: 22.464px;"><span style="color: #0b5394;">sudo apt-get install unrar-free</span></span></span></span></h3> </div> <div> <span style="font-size: large;"><span style="font-family: "arial" , "helvetica" , sans-serif;"><span style="letter-spacing: -1px; line-height: 22.464px;"><span style="color: #0b5394;"><br /></span></span></span></span></div> <div> <span style="font-size: large;"><span style="font-family: "arial" , "helvetica" , sans-serif;"><span style="letter-spacing: -1px; line-height: 22.464px;"><span style="color: #0b5394;">After That copy the shell script bellow and save it as hackthesec.sh</span></span></span></span></div> <div> <u><span style="color: red;"><i><br /></i></span></u></div> <div> <pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white; font-family: "courier new" , "courier" , monospace; font-size: medium;"><span style="line-height: 15.6px;">#!/bin/bash list=`find /home/hackthesec/ -type f -name "*.rar"` for line in $list; do DEST=${line%/*} unrar x $line $DEST done</span></span></pre> </div> <div> <h3 style="background-color: white; border: 0px; margin: 0px 0px 15px; padding: 0px;"> <br /><span style="color: #0b5394; font-family: "arial" , "helvetica" , sans-serif; font-size: 16pt; letter-spacing: -1px; line-height: 1.2em;">RUN-Shell Script Output</span></h3> </div> <div> <pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="color: white;"><span style="font-family: "courier new" , "courier" , monospace; font-size: medium;"><span style="line-height: 15.6px;">[root@go ~]# sh find.sh UNRAR 5.00 beta 3 freeware Copyright (c) 1993-2013 Alexander Roshal Extracting from /home/hackthesec/shell.rar Extracting /home/</span></span></span><span style="color: white; font-family: "courier new" , "courier" , monospace; font-size: medium; line-height: 15.6px;">hackthesec</span><span style="color: white; font-family: "courier new" , "courier" , monospace; font-size: medium; line-height: 15.6px;">/find.sh OK</span> <span style="color: white;"><span style="font-family: "courier new" , "courier" , monospace; font-size: medium;"><span style="line-height: 15.6px;">All OK [root@go ~]# </span></span></span></pre> </div> <div> <u><span style="color: red;"><i><br /></i></span></u></div> <div> <pre style="background: none 0px 0px repeat scroll rgb(60, 60, 60); border-radius: 4px; border: 1px solid rgb(229, 229, 229); color: #333333; font-size: 12px; line-height: 19.2px; margin-bottom: 20px; outline: 0px; overflow: auto; padding: 20px; vertical-align: baseline;"><span style="font-family: "courier new" , "courier" , monospace; font-size: medium;"><span style="line-height: 15.6px;"><span style="color: white;"><a href="http://www.hackthesec.co.in/" target="_blank">www.hackthesec.co.in</a> <a href="http://www.twitter.com/hackthesecurity">www.twitter.com/hackthesecurity</a></span></span></span></pre> </div> </div>

Shell Script : Find All Zip / Rar Files Then Unzip / Unrar

Find All Zip / Rar Files Then Unzip / Unrar We must first install and enable RPMForge repository under Linux systems to install Unrar and Rar command-line applications. We have provided RPMForge repo…

Read more »