Tutorials

How To Pull Content From Other Websites Automatically

Google+ Pinterest LinkedIn Tumblr

When it comes to blogging, content is king, both for your readers and for the search engine. The unique content you spread on the internet, the better-off your blog will fare in this competitive landscape.

There are several options to pull content from other Websites automatically. First from WP Web Scrapper and second from different tools like WordPress Plugins.

1. WP Web Scrapper

WP Web Scrapper is definitely not for the weak of heart, but it is for those of you who know what a “Jquery Selector” is. If you know what a “Jquery Selector” is, then you are in for one awesome coding treat. WP WebScrapper makes grabbing parts of ANY website and including it in a post or page on your blog, a snap!
WP Web Scrapper uses CURL and phpQuery to grab and manipulate data from any public website. Because WP Web Scrapper uses phpQuery, you have the luxury to select which elements you want from the external website using jQuery Selectors. Plus you do not need to be afraid if the external website changes, as WP Web Scrapper degrades gracefully if any changes occur.

Adding a scrapping:

To create a new Web Scrapping, you edit a post or a page. Once installed, WP Web Scrapper will include a new button in your Toolbar that looks like a Gear.

All that is needed for WP Web Scrapper to work is a valid website URL (Source URL) and a valid CSS Selector. Once you have added the external website’s URL (don’t forget the http://) and added your selector, click Insert. This plugin will create a short code that is inserted into the body of your post. Once you get familiar with the WP WebScrapper syntax, you will be able to add them without ever clicking the “Gear”. For example:

[wpws url=”” selector=”.product” ]

Learn more about CSS Selectors by visiting

https://code.google.com/archive/p/phpquery/wikis/Selectors.wiki

2. SimplePie Core WordPress

This plugin does absolutely nothing except load the core SimplePie library so that all other plugins that utilize SimplePie can all share the same up-to-date version. It also helps minimize potential conflicts between SimplePie-powered plugins.

The first step makes sure that you have the right SimplePie installed. SimplePie is a wonderful piece of software that makes consuming RSS and ATOM feeds very easy. It is a very fast and easy-to-use class, written in PHP, that puts the ‘simple’ back into ‘really simple syndication’. In most hosting companies like BlueHost, the SimplePie is enabled. So, All you have to run the test in the first step, that will open a new page with results. Otherwise, there is a SimplePie Core WordPress plugin, which is automatically used in place of the bundled version, and it allows you to update SimplePie easily for all the plugins that use it. Learn all the simple pie tips and tricks, usage and docs here.

Setting up a Cron job for SimplePie and SimplePie Plugin for WordPress

The second step allows you to select how automatic updates will occur; uncheck the box at the end of this step if you do not know how to set and use CRON job because you have to do some server magic in the SHELL.

3. WP-o-Matic

WP-o-Matic is the WordPress Plugin for automatically creating posts from the RSS/Atom feeds you choose, which are organized into campaigns, Also it is known as WordPress RSS Aggregator. This is awesome Plugin which has great flexibility and data import consistency, it can automatically pull content from your other blogs or online applications.

WP-O-Matic is a very complicated plugin, but insanely powerful. Imagine being able to take content from any website virtually, and automatically add it to your blog every time it is updated. With this plugin, you could hypothetically build a gigantic blog filled with tons of content, without ever manually posting.

Before the beginning, there are few steps you have to go through to make sure that all necessary software Like SimplePie available for this plugin to work like I mentioned above. On your first visit on the WP-O-Matic setting, you will be asked to click through a series of configuration options.

Creating a campaign for Collecting Feed:

Creating campaign

Campaigns give you the ability to group feeds and select common options for them. So, if you ever decide to change a setting, all the feeds in that logical group will be affected.
A collection of feeds (or a single feed) will be imported into a specific area that you define. For example, let’s say you want to create a new category dedicated to WordPress Tutorials. Then you would create a new campaign called “Community News” that would contain multiple RSS feeds from other websites and blogs that write about WordPress. Then, on a schedule which you define, WP-O-Matic will automatically grab the latest news and create a post for each new item in the feed.

Adding feeds:

Adding feeds

In this option tab, you can define the RSS or an ATOM feed you would like to include in your new campaign.
WP-O-Matic has a great feature if you are unsure what the RSS feed is for a given website; all you have to do is provide the website’s URL. For example, enter and WP-O-Matic will automatically locate the websites’ feed for you.

Categories:

Categories

You can define different categories for different feeds. This feature is awesome when you have a site that covers multiple topics and will be importing multiple types of content from different feeds.

Rewrite:

The rewriting settings allow you to replace parts of the content with the text you specify.

Basic rewriting

To replace all occurrences the word ass with butt, simply type ass in the “origin field”, and butt in “rewrite to”

WP-O-Matic’s options:

Each campaign has a slew of options available during import. The following is a breakdown of what each of the options will do. You can find more detail about all possible option on Options tab.

Copyright Warning

It’s important to note that while WP Web Scrapper and other WordPress Plugins and tools make ripping content from a website super simple, it doesn’t mean that it’s legal. There are many big websites out there that will not take kindly to someone stealing their content. Make sure that you have permission before you take another website’s content, or you might find a nice letter from some law firm in your mailbox.

Noor Mustafa Raza

I am a WordPress Developer and Designer, author @WPArena. I am providing Free WordPress consultation and can help you to install WordPress in a secure way to small businesses and bloggers.

6 Comments

  1. Noor Mustafa Raza

    Can you tell me how to stop or block my word press blog from automatically showing up on other websites when I want to post a comment? Thank you. I am a novice when it comes to blogging and I’m finding comments I’ve made on other sites suddenly showing up publishing my blog site when i don’t want it to do that! Thank yo for your help and time!!

    • Noor Mustafa Raza

      Hi Jan,
      Your WordPress Blog may be linked up with your Gravatar Profile. You can check it from gravatar.com, here you can check your blog is not linked 🙂 Some commenting systems do so like if jetpack powered comments are in place, then probably your WordPress Blog will be shown up in comments.

      Thanks,
      Jazib

  2. Noor Mustafa Raza
    Elayn Stageberg Reply

    thanks for the information, it will make things easier. but i have a question i.e. will google adsense allow after copying posts from other websites.

  3. Noor Mustafa Raza

    Isn’t it a breach of copyright and wouldn’t google penalize the website which is pulling data from another website and publishing it as it’s own?

  4. Noor Mustafa Raza

    Hi, non of the plugins above are available in WP for download. I have an affiliate job for them. Any thoughts?

Write A Comment

Pin It