In a world where technology is constantly evolving there is an ever increasing need for data and information, there has never been a greater need for access to data. This course will enable you to learn web scraping techniques to automate your data collection.
Learn how to collect information from websites and save data to a Google Spreadsheet, or setup a real-time database using Google Firebase to save and collect data to power your applications.
Leverage the power of Google Cloud Functions to host and deploy your scripts in the cloud, or import live data in real-time directly into your spreadsheets.
 Collect and store data in spreadsheets or a real-time database |
 Host and run your functions on the cloud using serverless technology |
 Automate your data collection efforts |
This course consists of numerous hours of video training which will take you step by step though the process of web scraping in NodeJS, deploying Google Cloud Functions, and much much more.
There will be step by step guide and projects for you to complete as well as full working code examples. In addition we have a range of free resources, guides, and templates available on our website.
To ensure you are well equipped, this course will cover the following libraries and technologies.
NodeJS Web scraping libraries
We will use the following highly popular NodeJS libraries to make requests to websites, submit forms, and more. Request-promise and Puppeteer with Headless Chrome.
Cheerio
This parsing library enables us to easily extract information from webpages.
Google Sheets
Store your data in a Google Spreadsheet like you would a database, allowing you to collect and analyse your data.
Firebase
A popular real-time database for storing and retrieving information. Firebase supports implementation into websites and apps.
Google Cloud Functions
To make the most of your scripts we'll deploy them live on the internet using Google Cloud Functions, allowing access to import real-time data into your spreadsheets or applications.
Course Prerequisites
- Have an understanding of HTML
- Have an understanding of website cookies
- Ideally an understanding of how APIs work and working with GET and POST requests
- Ideally some experience working with JavaScript
Course Difficulty
This course is considered to be at Beginner-Intermediate level, as some prerequisite foundation knowledge is required. A basic level understanding of the above listed prerequisites is sufficient.
Your Instructor
Luke Gackle
Technology is my passion, I'm constantly building and innovating trying to push the limits of technology and sharing my tools and resources here on Luke's Toolkit.
Comments
Post a Comment