Playing With Pandas

  • by

This is the third part of the articles I am writing about my little project I am working on. In part1, I created a web scraper to get the data I needed. In part 2, I added support to save the collected data to a MongoDB database. Now in this part, I will look into how to clean up and add new features (columns) to the collected data to make it more suitable for analysis.

My primary motivation here is to learn new technologies as I progress, so my baby steps may not be the state of art in this particular area and all tips and tricks or corrections are welcome.

For this project, I am using python and each day I love it more and more. There are some cool libraries for python such as pandas that will be used. There are some cool tools such as python notebooks that will be also used.

For starts, make sure that you have jupiter notebook installed on your machine and then start Jupyter Notebooks from the git repo folder.

pip install jupiter
cd /path/to/stackjobs
jupiter notebooks

With this command, we started the iPython (Jupyter) notebooks and a new browser will be opened. Click on the Enhancing and Extending data with Pandas notebook to see and run the code that this article with describe. Also, the enhance_data_with_pandas.py file contains the same code, so it can be run without iptyhon notebook.

Read More »Playing With Pandas

Getting Started With Handsontable

  • by

I am looking for a way to be able to display and manipulate tabular data on a webpage. For this, I decided to evaluate a few javascript based libraries and see how they can be used.

The first such library is called handsontable. Handsontable is a Javascript/HTML5 Spreadsheet library for developers. It seems that Handsontable is more for building Excel-like user interfaces than just simple data grid control.

So let’s look at how easy to build a minimal example using with handsontable

The main web-page describes this library as:

Handsontable is a composite spreadsheet component for apps and websites. It is written in JavaScript and not constrained by any external framework. Handsontable can be easily modified or extended with custom plugins. It also binds to any source using the JSON format and is capable of handling a large amount of data. You can easily do all CRUD operations and provide end-users with an Excel-like experience.

Creating the minimal Handsontable page

First of all, click to download the source code for the minimal handsontable sample.

The first file to be created is the index.html

Index.html
Read More »Getting Started With Handsontable