When done right, web scraping is a powerful tool that can give businesses a competitive edge in today’s data-driven world.

Github has grown to more than 40 million developers and its growth is getting a big boost from data science, artificial intelligence and machine learning repositories.

Eventually he located the data feed for a tanker ship and wired his dial to display the ship’s speed. He uses a Python script to interface with the Pachube API, which is fed to his Netduino board.

There's a rush to amass as much data as possible to train AI models. Amazon is trying to scrape Microsoft's Github for some of the data it needs.