Disabling Captive Portal Check in Android
I recently had an issue with an Android phone that kept disconnecting from the wifi network after a certain period. The wifi was configured to… Read More »Disabling Captive Portal Check in Android
I recently had an issue with an Android phone that kept disconnecting from the wifi network after a certain period. The wifi was configured to… Read More »Disabling Captive Portal Check in Android
This is the third part of the articles I am writing about my little project I am working on. In part1, I created a web scraper to get the data I needed. In part 2, I added support to save the collected data to a MongoDB database. Now in this part, I will look into how to clean up and add new features (columns) to the collected data to make it more suitable for analysis.
My primary motivation here is to learn new technologies as I progress, so my baby steps may not be the state of art in this particular area and all tips and tricks or corrections are welcome.
For this project, I am using python and each day I love it more and more. There are some cool libraries for python such as pandas that will be used. There are some cool tools such as python notebooks that will be also used.
For starts, make sure that you have jupiter notebook installed on your machine and then start Jupyter Notebooks from the git repo folder.
pip install jupiter
cd /path/to/stackjobs
jupiter notebooks
With this command, we started the iPython (Jupyter) notebooks and a new browser will be opened. Click on the Enhancing and Extending data with Pandas notebook to see and run the code that this article with describe. Also, the enhance_data_with_pandas.py file contains the same code, so it can be run without iptyhon notebook.
Read More »Playing With PandasI am looking for a way to be able to display and manipulate tabular data on a webpage. For this, I decided to evaluate a few javascript based libraries and see how they can be used.
The first such library is called handsontable. Handsontable is a Javascript/HTML5 Spreadsheet library for developers. It seems that Handsontable is more for building Excel-like user interfaces than just simple data grid control.
So let’s look at how easy to build a minimal example using with handsontable…
The main web-page describes this library as:
Handsontable is a composite spreadsheet component for apps and websites. It is written in JavaScript and not constrained by any external framework. Handsontable can be easily modified or extended with custom plugins. It also binds to any source using the JSON format and is capable of handling a large amount of data. You can easily do all CRUD operations and provide end-users with an Excel-like experience.
First of all, click to download the source code for the minimal handsontable sample.
The first file to be created is the index.html
Let’s continue with our project. To summarise what we did in the first part, we wrote a scraper in python using the scrapy framework that was capable of… Read More »Scraping Stackoverflow Careers for Fun and Profit – Part 2
When you want to learn something new the best way to do is to come up with a problem that can be useful to you… Read More »Scraping Stackoverflow Careers for Fun and Profit
I will teach you how to create Typescript classes from your existing C# classes effortlessly like a pro within 30 seconds.
Read More »How to Generate Typescript Classes From C# Like a ProI am recently trying to use protobuf.net for serializing objects for network communication in a .net application. Protobuf is a great format for sending data.… Read More »Serializing Empty IEnumerable With protobuf.net
I love thewirecutter.com. I like them a lot. They are posting really well-researched reviews about stuff I care about a lot. Headphones, smartphones, TVs, NAS.… Read More »The Problem With Wirecutter
“Porcelain” is the material from which toilets are usually made (and sometimes other fixtures such as washbasins). This is distinct from “plumbing” (the actual pipes… Read More »What Does the Term Porcelain Mean in Git
So is Noda Time perfect then? Of course not. Noda Time suffers several problems: Despite all of the above, I’m a rank amateur when it… Read More »Reading About Date and Time