Explore information related to files

Googlebot cannot access CSS and JS files – Resolve crawl errors ?

This guide covers website crawl errors, Googlebot cannot access CSS and JS files. Google bot and other search spiders will visit the robots.txt file of your website immediately after they hit the htaccess file.

Htaccess has rules to block ip addresses, redirect URLs, enable gzip compression, etc. The robots.txt will have a set of rules for the search engines too. 

They are the reason you received "Googlebot Cannot Access CSS and JS files". 

Robots.txt has few lines that will either block or allow crawling of files and directories. Google has started penalizing websites that block the crawling of js and css files.

The JavaScript and cascading style sheets are responsible for rendering your website and they handle forms, fire events, and so on.

If the JS is blocked, Google bot will not be able to crawl the code and it will consider the code as a spam or violation of link schemes. 

The same logic applies for the CSS files.


To resolve "Googlebot Cannot Access CSS And JS Files" Warning:

1. You need to remove following line: Disallow: /wp-includes/

Depending upon how you have configured your robots.txt file, it will fix most of the warnings. 

You will most likely see that your site has disallowed access to some WordPress directories like this:

User-agent: *

Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /wp-content/plugins/
Disallow: /wp-content/themes/

2. You can override this in robots.txt by allowing access to blocked folders:

User-agent: *
Allow: /wp-includes/js/

Read More


Recover orphan innodb database from ibd file - How to perform this task

This article covers how to recover the orphan InnoDB database from the ibd file. 


Orphan InnoDB database incident mostly happened when:

1 – user accidentally remove ibdata1 file. (mostly in /var/lib/mysql/ibdata1).

2 – ibdata file courrupted.


To Recover Orphaned InnoDB Tables:

1. Restart the MySQL service to recreate ibdata1, then take a backup of your database folder.

2. Login to MySQL.

3. Create a dummy database with the same name. Then, create a dummy table with the same name as the corrupted one (don’t mind the table structure for now).

4. Stop the MySQL service, copy the .frm file from the backup you took to replace the .frm file.

5. Start MySQL and have a look at the structure of your table - it should now be in place! However, don’t get too happy yet.

6. Issue a SHOW CREATE TABLE statement and copy its contents, then create the table with them.

7. Stop MySQL, copy the .ibd file from the backup directory to /var/lib/database_name and replace the existing .ibd file from the dummy table.

8. Now it’s time for Percona’s tools to shine - download and install the Percona Data Recovery Tool for InnoDB , then run the following (here -o represents the full location of your ibdata1 file, -f represents the full location of your .ibd file, -d represents the database name and -t represents your table name):

ibdconnect -o /var/lib/mysql/ibdata1 -f /var/lib/mysql/database_name/table_name.ibd -d database_name -t table_name

9. Now, run a checksum check against InnoDB - make sure you get no error messages (you might need to run this tool several times):

innochecksum /var/lib/mysql/ibdata1

10. Finally, you should be good to go - simply start MySQL.

Read More


Files and Processes in SELinux on CentOS 7 - More information

This article covers Files and Processes in SELinux. Basically, managing file and process context are at the heart of a successful SELinux implementation.

With SELinux, a process or application will have only the rights it needs to function and NOTHING more. The SELinux policy for the application will determine what types of files it needs access to and what processes it can transition to. 

SELinux policies are written by app developers and shipped with the Linux distribution that supports it. A policy is basically a set of rules that maps processes and users to their rights.


SELinux enforces something we can term as “context inheritance”. What this means is that unless specified by the policy, processes and files are created with the contexts of their parents.

So if we have a process called “proc_a” spawning another process called “proc_b”, the spawned process will run in the same domain as “proc_a” unless specified otherwise by the SELinux policy.


SELinux in Action: Testing a File Context Error

1. First, let's create a directory named www under the root. We will also create a folder called html under www:

mkdir -p /www/html

 

2. If we run the ls -Z command, we will see these directories have been created with the default_t context:

ls -Z /www/

drwxr-xr-x. root root unconfined_u:object_r:default_t:s0 html


3. Next we copy the contents of the /var/www/html directory to /www/html:

cp /var/www/html/index.html /www/html/

 

The copied file will have a context of default_t. That's the context of the parent directory.


We now edit the httpd.conf file to point to this new directory as the web site's root folder. 

i. We will also have to relax the access rights for this directory.

vi /etc/httpd/conf/httpd.conf

ii. First we comment out the existing location for document root and add a new DocumentRoot directive to /www/html:

# DocumentRoot "/var/www/html"

DocumentRoot "/www/html"

iii. We also comment out the access rights section for the existing document root and add a new section:

#<Directory "/var/www">

#    AllowOverride None

    # Allow open access:

#    Require all granted

#</Directory>


<Directory "/www">

    AllowOverride None

    # Allow open access:

    Require all granted

</Directory>


We leave the location of the cgi-bin directory as it is. We are not getting into detailed Apache configuration here; we just want our site to work for SELinux purposes.


iv. Finally, restart the httpd daemon:

service httpd restart

 

Once the server has been restarted, accessing the web page will give us the same “403 Forbidden” error (or default “Testing 123” page) we saw before.

The error is happening because the index.html file's context changed during the copy operation. It needs to be changed back to its original context (httpd_sys_content_t).

Read More


How to set up phpBB Forum on a website through cPanel

This article covers phpBB which is a completely free open-source Forum Software. It has lots of features while maintaining efficiency and ease of use. 

#phpBB, which is an abbreviation for PHP Bulletin Board, is one of the best free and open-source forum scripts for creating a forum. 


There are two ways to install phpBB on a website:

1. You can #install phpBB manually

2. Install phpBB via #cPanel Softaculous Apps Installer


To create a forum in phpBB:

1. Click Forums.

2. Enter the name of the new forum here.

3. Click Create new forum.

4. Enter a description for the new forum here.

5. Click Submit. 

That's it! The forum has been successfully created.


To Create a phpBB Forum:

1. Download and Install phpBB. The first thing you'll need to do is download the phpBB software.

2. Register Your phpBB Forum Administrator Account.

3. Set Up Your phpBB Forum.

4. Start Creating Content.


phpBB’s best features that you can use to help launch your first online forum:

1. Responsive design — supports the latest version of HTML5 and CSS3, thus providing you with a responsive and cross-browser compatible design.

2. Search engine crawler handling — comes with configurations and access control for over 100 crawlers for board optimization.

3. Unread message tracking — notifies users whether or not they have seen new published posts and topics.

4. Private message system — allows users to send direct messages to each other via the forum.

5. COPPA registration — prevents underage users from registering to the forum.

6. OAuth login — allows users to register using Google, Bit.ly, or Facebook accounts.

7. Data management — supports various popular database management tools like MySQL, Oracle Database, and SQLite.


Reasons why you should consider creating an online forum:

1. Encourage discussion and feedback — users can use the available space to exchange ideas and give you insights into the quality of your content for further improvement.

2. Support audience research — lets you observe visitor preferences and browsing habits in a closed environment.

3. Build a community — having great communication and sharing similar interests with other people will give your users a sense of belonging to a community.

Read More


Manually Migrate Accounts to cPanel

This article covers how to manually #migrate accounts to cPanel/WHM, as well as the steps to fix common errors faced while migrating.


After you migrate your files to your new cPanel & WHM server, perform the following steps:

1. Confirm that all of the content and credentials migrated properly and that they function in the new environment.

2. Update your domain's nameservers to match the new nameservers on your cPanel & WHM server.

3. Create cPanel and reseller accounts. To do this, use WHM's Create a New Account interface (WHM >> Home >> Account Functions >> Create a New Account).


After you create the new #cPanel & #WHM account, migrate the old server’s files and directories to the appropriate locations on your new server.


Generally, you will migrate the following files and directories during this process:

1. The public_html directory contains all of your files, directories, subdirectories, and content. This directory may appear as the /home/user/www directory or the /home/user/vhost directory on some systems.

2. The /home/user/mail directory contains all of the email files for all of the cPanel account’s email accounts.

3. The /home/user/tmp directory contains the account’s temporary files and bandwidth and statistics data. For example, you can migrate your original server's AWStats data to the /home/user/tmp/awstats directory.

4. The /home/user/etc directory contains the email account password, shadow, and quota files for email accounts. For example, you can migrate your original server’s email account quota data to the /home/user/etc/quota directory.

5. The /home/user/ssl directory contains the SSL certificates for the domains on the account.

6. The mysql directory stores the MySQL databases for every account on the server.

7. The /var/lib/pgsql directory stores the PostgreSQL databases for every account on the server.

Read More


Ubuntu error Some index files failed to download

This article covers methods to fix #Ubuntu #error "Some index files failed to download". You can resolve this error by copying the contents of the sources list file from another functional Ubuntu system and paste them into your system's sources list file.

To install community-supported #software packages, proprietary packages, and packages not available under a completely free license, you might consider enabling the following repositories:
1. Universe – Community-maintained free and open-source software.
2. Restricted – Proprietary drivers for devices.
3. Multiverse – Software restricted by copyright or legal issues.

To enable these #repositories, invoke the commands below:
$ sudo add-apt-repository restricted
$ sudo add-apt-repository multiverse
$ sudo add-apt-repository universe

Then update your package lists:
$ sudo apt update

Read More


Malicious TMP files and processes

This article covers method to resolve malicious tmp processes. Most malware installers delete itself and these TMP files after successful installation.
The use of TMP files for atomicity is an advantage attackers currently enjoy.
They could have done this operation in any folder of the system, but they choose to use the standard Windows Temp folder.
The first thing a malware installer (first stage of infection) does when executed on a target system - be it a dropper or downloader - is to install a copy of the malware and its components into their corresponding location in the system.

Read More


WordPress Upload Failed to Write File to Disk error

This article will guide you on how to resolve 'Upload: Failed to Write File to Disk' Error in WordPress. 

The Upload: Failed to Write File to #Disk WordPress error can occur due to a number of reasons. 

The most typical cause of the error is incorrect folder permissions. 

But besides incorrect permissions, this error can also ocurr due to your website exceeding the quota limit of the hosting service.

To fix this #WordPress #error:

1. Try changing the permissions on the wp-content directory to 766. 

2. If you still have problems, try 767, 775 or 777. 

3. Once your uploads are working, change the permissions on wp-content back to 755 again and check that everything still works OK.

Read More


Duplicity restore full backup

This article will guide you on steps to perform a Duplicity-restore full backup. #Duplicity is an efficient #backup application.

#rsync is a protocol built for Unix-like systems that provides unbelievable versatility for backing up and synchronizing data. It can be used locally to back up files to different directories or can be configured to sync across the Internet to other #hosts.

Incremental Backup captures only the changes made since the last incremental backup. Saves both time and #storage space, and ensures that your backup is up to date. Differential Backup captures only the changes made since the last full backup, not since the last differential backup.

When a normal or full backup runs on a selected drive, all the files on that drive are backed up. This, of course, includes system files, application files, user data — everything. The downside of normal backups is that they take a very long time to run, and in some cases this is more time than a company can allow.

To Use Duplicity with GPG to Securely Automate #Backups on #Ubuntu:

1. Install the Prerequisite Packages.

2. Download and Install Duplicity from Source.

3. Create SSH Keys.

4. Create GPG Keys.

5. Run an Initial Test.

6. Create Your First Backup.

7. Restore a Backup.

Read More


VestaCP mail not working How to fix

This article will guide you on different methods to resolve #Vestacp #mail #problems which generally occurs mainly due to #Exim problem, firewall issues, and so on. This tips will resolve the #email problems in VestaCP.

To fix email not working:

1. Verify your internet connection is working. If it's not, there are four things you can do to fix it.

2. Make sure you're using the correct email server settings.

3. Confirm your password is working.

4. Confirm you don't have a security conflict caused by your firewall or antivirus #software.

Read More


Improve SQL Server Bulk Data Import Performance

This article will guide you improve #bulk #data #import #performance. The BULK INSERT command is much faster than bcp or the data pump to perform text file import operations, however, the BULK INSERT statement cannot bulk copy data from #SQL Server to a data file. Use the bcp utility instead of DTS when you need to export data from the SQL Server table into a text file.
To Speed up SQL Bulk Insert with #transactions:
1. Declare the variables that store the number of desired items ( @items ), the size of the chunks( @chunk_size ) and the counter of the number of executed inserts( @counter )
2. Open the first transaction and initialize the while loop.

Read More


Rsync to Exclude Files and Directories

This article will guide you on easily exclude #files and #directories using the #rsync #command.
The --exclude option with the rsync command uses relative paths to the source #directory. Append the --exclude option to the rsync command, followed by the relative path to a directory or file(s).
The basic syntax for the rsync exclude option looks like this:
rsync [OPTIONS] --exclude 'file_or_directory' source/ destination/
Replace source/ with the directory name you want to use as a source for data transfer to another location.
Replace destination/ with the directory name rsync will use as the target location for your data. If the directory does not exist, rsync creates one for you and transfers the files to that directory.

Read More


Rsync from Linux to Windows share

This article will guide you on how to use #Rsync to transfer #files from #Linux to #Windows share.

cwRsync is an implementation of rsync for Windows. rsync uses a file transfer technology specified by the rsync algorithm, transferring only changed chunks of files over the network. #cwRsync can be used for remote file backup and synchronization from/to Windows systems.

Syntax of rsync #command:

1. -v, –verbose Verbose output.

2. -q, –quiet suppress message output.

3. -a, –archive archive files and directory while synchronizing ( -a equal to following options -rlptgoD).

4. -r, –recursive sync files and directories recursively.

5. -b, –backup take the backup during synchronization.

Read More


Virtual Log Files in SQL Server

This article will guide you on how to find the total number of #VLFs. The DMF sys.dm_db_log_info specifically looks at virtual log files or VLFs for which it needs a database ID for input.

To find it, check the number of virtual log files (VLFs) in each #database and alerts when there's 1,000 or more.

Read More


Managing files with fs Module in Node js

This article will guide you on various functions that can be performed with fs #Module in Node.js such as reading, writing, and deleting files.

#Node . js includes fs module to access physical file system. The #fs module is responsible for all the asynchronous or synchronous file I/O operations.

To use FS in node JS:

The Node. js file system #module allows you to work with the file system on your #computer. To include the File System module, use the require() method: var fs = require('fs'):

1. Read files.

2. Create files.

3. Update files.

4. Delete files.

5. Rename files.

Read More


Using FreeBSD Single-User Mode to recover from File System Corruption

This article will guide you on how to recover from #File #System #Corruption Using FreeBSD's Single-User Mode.

While #filesystem corruption is never a good thing, it doesn't necessarily mean that all of your important data was lost. The success of your #recovery #operations comes down to a number of factors, such as how quickly the filesystem noticed the corruption, how widespread the issue was, and what files were affected.

Corrupted files are computer files that suddenly become inoperable or unusable. There are several reasons why a file may become corrupted. In some cases, it is possible to recover and fix the corrupted file, while at other times it may be necessary to delete the file and replace it with an earlier saved version.

To fix corrupted files in #Windows 10:

1. Use the #SFC tool.

2. Use #DISM tool.

3. Run SFC scan from Safe Mode.

4. Perform SFC scan before Windows 10 starts.

5. Replace the files manually.

6. Use System #Restore.

7. Reset your Windows 10.

Read More


Rewrite URLs with mod_rewrite for Apache on Ubuntu 16 04

This article will guide you on how to rewrite URLs with mod_rewrite in #Apache. Basically, mod_rewrite helps in creating human-readable URLs.

The URL #Rewrite #Module is an extension software for #IIS (Internet Information Services). URLs should be created so that they are easy to remember for the users and easy to find for the search engines. The URL Rewrite Module enables web administrators to develop and implement rules that assist them in this task.

htaccess rewrite rule includes setting a combination of rewrite condition ( #RewriteCond ) tests along with a corresponding rule ( #RewriteRule ) if the prior conditions pass. In most cases, these rules should be placed at any point after the RewriteEngine line.

Read More


PHP-FPM Code and FileSystem Layout for EasyApache 4

This article will guide you on how PHP FastCGI Process Manager (PHP-FPM) daemon works. PHP-FPM Code and FileSystem Layout for EasyApache allows the website to handle loads. 

As PHP-FPM receives a proxied connection, a free PHP-FPM worker accepts the web server's request. PHP-FPM then compiles and executes the PHP script, sending the output back to the web server. Each PHP user can have its own separate pool of worker processes for handling PHP requests.

FPM (FastCGI Process Manager) is an alternative PHP FastCGI implementation with some additional features (mostly) useful for heavy-loaded sites. These features include:

i. Ability to start workers with different uid/gid/chroot/environment.

ii. listening on different ports and using different php. ini (replaces safe_mode).

Read More


Steps to Install GoAccess on Ubuntu

This article will guide you on how to #Install GoAccess on Ubuntu which is a command-line tool and how to use it for analyzing server #logs.
With #GoAccess, you are able to #SSH into any web server you control and view or analyze relevant statistics quickly and securely. Apart from the command-line dashboard interface, it's also capable of displaying the #statistics in other formats such as HTML, JSON, and CSV, which you can use in other contexts or share with others.

Read More


Missing DLL files errors on Windows 10

This article will guide you on how to resolve #Windows Missing DLL files. A recent #application #installation sometimes overwrites an existing DLL file with an incompatible or invalid DLL file. A malicious #program has deleted or damaged a #DLL file.
To add a missing . DLL file to Windows:
i. Locate your missing . dll file at the DLL Dump site.
ii. Download the file and copy it to: "C:\Windows\System32".
iii. Click Start then Run and type in "regsvr32 name_of_dll. dll" and hit enter.

Read More


How to install WordPress using One-Click Install on DigitalOcean

This article will guide you on the process to install #WordPress by using One-Click Install feature on DigitalOcean.
#DigitalOcean is a cloud hosting provider headquartered in New York City with data centers across the globe. Its seamless connectivity allows users to deploy and scale multiple web applications simultaneously without any lag. DigitalOcean offers private virtual Linux OS-powered machines called  ‘droplets’.

Read More


Steps to Setup Ansible AWS Dynamic Inventory

This article will guide you on how to use #AWS resources using Ansible with the help of Dynamic Inventory.

The #Ansible #inventory file defines the #hosts and groups of hosts upon which #commands, #modules, and tasks in a playbook operate. The file can be in one of many formats depending on your Ansible #environment and plugins.

Ansible will use it as an inventory source as long as it returns a #JSON structure like the one above when the script is called with the --list .

Read More


Secure Wamp Server How to do it effectively

This article will guide you on the different methods to secure #WAMP Server. Basically, WAMP provides support for #MySQL and #PHP. It can be used in production under condition that you install the secure WAMP #distro and it can run on #Internet and not just #intranet.

Read More


Download multiple files simultaneously using cURL

This article will guide you on the process to #download multiple files using curl utility. Curl allows downloading files simultaneously from a remote system.

The curl tool lets us fetch a given #URL from the command-line. Sometimes we want to save a web file to our own computer. Other times we might pipe it directly into another program. Either way, #curl has us covered.

This is the basic usage of curl:

curl http://some.url --output some.file

Read More


Process to rsync only new files in Linux

This article will guide you on the steps to #transfer only the new files using rsync locally and from Local to #Remote #Linux.

Syncing to a remote system is trivial if you have SSH access to the remote #machine and #rsync installed on both sides. Once you have #SSH access verified between the two machines, you can #sync a folder to a remote #computer by using the rsync syntax.

Read More


Rsync error code 3 Steps to fix it

This article will guide you on the steps to resolve #Rsync #error code 3 which occurs while trying to #transfer #files from one server to another via rsync.

Read More


Sync Two CentOS 8 Servers Using File Replication

The #sync command forces an immediate write of all cached data to disk. Run sync if you anticipate the system to be unstable, or the storage device to become suddenly unavailable, and you want to ensure all data is written to disk. Individual files may be synced, or the entire filesystem containing the specified files.

This article will guide you on the right steps to sync two #CentOS 8 #servers using file replication.

Read More


Invalid State of a Virtual Machine on VMWare ESXi

This article will guide you on the steps to resolve the Invalid State of a Virtual Machine on VMWare #ESXi error which relates to #orphaned virtual machines.

A virtual machine can show up as invalid or orphaned in these situations. After a vMotion or #VMware DRS migration. After a VMware HA #host failure occurs, or after the #ESX host comes out of maintenance mode. A virtual machine is deleted outside of vCenter Server. #vCenter Server is restarted while a migration is in progress.

Read More


Outlook PST file Cannot Be Opened

This article will guide you on the steps to solve #Outlook error "Outlook #PST cannot be opened" by applying different methods.

Read More


Solve Oversized OST File issues in Outlook

This article will guide you on the different methods to fix an over-sized OST file which affects data accessibility and synchronization.

Read More


RM cannot remove read-only file system tips to fix

This article will guide you on how to fix 'rm cannot remove the read-only file system' error  by simply removing files from the read-only file system.

Read More


Solution to error VMWare virtual machine disks consolidation is needed

This article will help you to fix the warning error "VMWare: virtual machine disks consolidation is needed" experienced when trying to delete a snapshot, the snapshot VMDK files or logs have not been deleted correctly.

Read More


How to securely back up your Linux Ubuntu Centos and Debian Server

#Backup and #restore refers to technologies and practices for making periodic copies of data and applications to a separate, secondary device and then using those copies to recover the data and applications—and the business operations on which they depend in the event that the original data and applications are lost.

#rsync uses what is called a delta-transfer algorithm which compares files from source and destination and sends only the differences between them.


To automatically backup #files and directories in Linux:

1. archive the content. Backing up your files using tar is very simple using the following command: # tar -cvpzf /backup/backupfilename.tar.gz /data/directory.

2. create backup script. Now let's add tar command in a bash script to make this backup process automatic.


#Rsync, or Remote Sync, is a free command-line tool that lets you transfer files and directories to local and remote destinations. 

Rsync is used for mirroring, performing backups, or migrating data to other servers.

Backing up file systems means copying file systems to removable media (such as tape) to safeguard against loss, damage, or corruption. 

Restoring file systems means copying reasonably current backup files from removable media to a working directory.

Data losses can be a very frustration encounter for a server owner. To avoid such catastrophic situations in losing your website data, it is very important to do a regular backup for your server and website.

Read More