Skip to main content

How to parse HTML/ extract data from HTML / using Java?

Java has a large set of APIs to parse HTML. To extract data from HTML  and perform any manipulation we should be able to parse it.

jsoup provides a very easy to use , powerful and compact API to pare HTML and extract data. It supports DOM, CSS and jquery like selectors.

It is designed for all types of HTML and will even parse HTML which is not perfectly valid.


Example

In this example we fetch BBC Sport , parse it to DOM and then select headlines using css-selector.

Document doc = soup.connect("http://www.bbc.co.uk/sport/0/").get();
 Elements newsHeadlines = doc.select("#more-news-headlines li");


We can also provide HTML directly in a string. 

A detailed documentation is available at jsoup website. You may start from official cook book available here. 


Labels:

Comments

Post a Comment

Popular posts from this blog

How to add JCalendar/ date chooser to WindowBuilder, for Swing GUI in Java?

WindowBuilder is most popular eclipse plugin for drag and drop GUI design. It supports SWT and Swing. Swing does not have a date chooser component of its own. But there are many components available that you can use. My personal favourite is JCalendar . You can add JCalendar components to your WindowBuilder  palette  by following these instructions. Download and extract JCalendar.  Right-click on the palette   in WindowBuilder Select jar file of Jcalendar select all componetnts Restart Eclipse. Now you will see JCalendar components in your  palette . For more information about  visit this page.  
12 comments
Read more

Why use shopify?

Are you looking to setup an online store? You can setup your store and you can start selling in a week. There are many platforms available to use but Shopify is easiest, reliable and SEO friendly.   Not familiar with Shopify ? It is a great way to sell tour products, without worrying about managing a server, payment gateways, etc. as for a small monthly fee everything is included.  Click here to create a free trial store and start exploring. 
22 comments
Read more

Loading data in MySQL Table from a Text File

There are many situation when we need to load some text data into a table. In this post I will tell you some simple steps to load Data into a MySQL table from a text File . First of all data should be in proper format Fields/ Columns should be separated by some character like space, tab or comma etc. Rows /Records/ Lines should be separated by some character like "\r\n" if there is one record per line. If data is Enclosed using some character it should be same for all columns. Create a Table in MySQL to hold data. Use LOAD DATA command to load data into the Table. Example: I have following data saved in a file c:\sample.txt "http://dbpedia.org/resource/AfghanistanHistory" "http://www.w3.org/2000/01/rdf-schema#label" "AfghanistanHistory" "http://dbpedia.org/resource/AfghanistanGeography" "http://www.w3.org/2000/01/rdf-schema#label" "AfghanistanGeography" "http://dbpedia.org/resource/Access...
34 comments
Read more