I recently had an issue with an Android phone that kept disconnecting from the wifi network after a certain period. The wifi was configured to… Read More »Disabling Captive Portal Check in Android
This is the third part of the articles I am writing about my little project I am working on. In part1, I created a web scraper to get the data I needed. In part 2, I added support to save the collected data to a MongoDB database. Now in this part, I will look into how to clean up and add new features (columns) to the collected data to make it more suitable for analysis.
My primary motivation here is to learn new technologies as I progress, so my baby steps may not be the state of art in this particular area and all tips and tricks or corrections are welcome.
For this project, I am using python and each day I love it more and more. There are some cool libraries for python such as pandas that will be used. There are some cool tools such as python notebooks that will be also used.
For starts, make sure that you have jupiter notebook installed on your machine and then start Jupyter Notebooks from the git repo folder.
pip install jupiter cd /path/to/stackjobs jupiter notebooks
With this command, we started the iPython (Jupyter) notebooks and a new browser will be opened. Click on the Enhancing and Extending data with Pandas notebook to see and run the code that this article with describe. Also, the enhance_data_with_pandas.py file contains the same code, so it can be run without iptyhon notebook.Read More »Playing With Pandas
So let’s look at how easy to build a minimal example using with handsontable…
The main web-page describes this library as:
Creating the minimal Handsontable page
First of all, click to download the source code for the minimal handsontable sample.
The first file to be created is the index.htmlRead More »Getting Started With Handsontable
Let’s continue with our project. To summarise what we did in the first part, we wrote a scraper in python using the scrapy framework that was capable of… Read More »Scraping Stackoverflow Careers for Fun and Profit – Part 2
When you want to learn something new the best way to do is to come up with a problem that can be useful to you… Read More »Scraping Stackoverflow Careers for Fun and Profit
I will teach you how to create Typescript classes from your existing C# classes effortlessly like a pro within 30 seconds.Read More »How to Generate Typescript Classes From C# Like a Pro
I am recently trying to use protobuf.net for serializing objects for network communication in a .net application. Protobuf is a great format for sending data.… Read More »Serializing Empty IEnumerable With protobuf.net
“Porcelain” is the material from which toilets are usually made (and sometimes other fixtures such as washbasins). This is distinct from “plumbing” (the actual pipes… Read More »What Does the Term Porcelain Mean in Git