#Link grabber install#
#Link grabber driver#
#Link grabber software#

A scammer could also prevent you from taking action that disrupts their illegal activities. Websites may cut you off from accessing their content. The same thing applies to browsing the web in general.

Your IP address isn't eligible to access the game. I decided to work on the script using Python due to the fact that I wanted to practice and learn more about Python.So, you're trying to play this online game and what you get is a pop-up notification that says, 'Access denied.' When this happens, there could be only one reason.

#Link grabber software#

Normally I would google a software or program that would allow me to do just that, but as a student studying in Computer Science(with a concentration in Software Engineer), I felt it was time to create and work on a project. User's 频道 (channel) pages which in most cases are single page application(meaning url doesn't change no matter which page you're on)Īs a data hoarder, anime enthusiast, and a self proclaim Japanophile, I needed a way to get all the video links from certain BiliBili pages in order to download it. User's 投稿(submissions) pages and with the 全部(all) filter This script is intended to be used on the following BiliBili pages: Note: It is reccommended that to include '&' in any of the argument that the entire argument gets enclosed in quotes or double quotes. q, -quiet Limit the information printed onto the console as the script executes a, -append Scrape links to an existing csv file p, -page Select specific page(s) to scrape Prevent links from being extracted on same page as w, -wait The amount of second to stop and wait for browser to load. p, -save The user's chosen absolute save path for the csv file h, -help show this help message and exit The file is temporary and will probably be removed after a little more progress on the link scraper script. This executable file does not involve command line arugments, thus making it easier to use. The executable file in the repository is a basic demo version of the current link scraper script. It should be noted that the default ouput for the csv file will be in the same folder as this script.

#Link grabber driver#

It is also recommended that the ChromeDriver is installed and placed in the same folder as this script as there would be no need to specify the driver path later on. ChromeDriver which is required to work with Selenium, and ensure you're downloading the version that matches your Chrome build.Note it is recommended that pip is installed and/or up to date.

#Link grabber install#

A requirements text file will be included and the command pip3 install -r requirements.txt (or pip)can be used to install the required modules(also ensure that python was installed on path if errors involving pip pops up).

Therefore, the following needs to be installed: ChromeDriver is also required to navigate through BiliBili. This script requires non-standard modules: requests, BeautifulSoup, and Selenium. The csv file can be used by annie or youtube-dl(not recommended as youtube-dl doesn't download all parts of the video) to download every single video with the given url in the csv file. Rather than right clicking each video in order to obtain its url, this script is designed to allow users to obtain all the video urls from each page and writing all of that into a csv file. Currently it is able to scrape all video links from search result pages, user's 投稿(submissions) pages, and user's 频道 (channel) pages. This is a simple script that scrapes all the video urls from certain BiliBili pages.