Skip to content
This repository has been archived by the owner on Nov 13, 2024. It is now read-only.

Basic Web Scraper minimising copying and pasting...

Notifications You must be signed in to change notification settings

ZHD1987E/25th-STePS-WebScraper

Repository files navigation

What is this?

This was originally built for the 25th STePS, and was originally intended to provide a list of projects. However, I have since expanded the webscraper's ability to find project videos and even group members.

All data I obtained is taken from the event website as-is, which means any typos or mistakes on the site, will be reflected on the data provided here.

Why is this made?

"A previous iteration of STePS had 120 exhibitors, taking up the entire School of Computing"

- Annad, 2024

Unfortunately, as easy and copying and pasting may seem, doing so for a large number of projects would be exceptionally difficult to do so, especially to multiple documents and that leads to wasted time and many people being roped in just to do this task.

Me, the tedium hating person, decided to create this webscraper that provides ready-made reports and even a JSON export for Google Apps Scripts to autopopulate documents.

Any limitations to be aware of?

Well, for now I cannot download YouTube videos, so good luck doing 120 project videos (unlikely).

Anyway, I do have reservations downloading videos from YouTube (who knows? there's degradation of quality, or maybe even malware on the downloaded files). Might as well ask groups to drop it off in a common folder.

Also, the 26th STePS website may change in terms of format, so what works here, may not work in future events. Just fork this out, and modify according to what works.

About

Basic Web Scraper minimising copying and pasting...

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages