Skip to content

nvo87/MyWebScrapper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MyWebScrapper

My pet project using Flask framework. N|Solid

Overview

This app can scraps values you need from any sites. This values are saved into database and later you can browse history of data you want (ex. weather or bitcoin cost). All you need is to know url and tag selector with data you want.

Install (on Windows)

  • Install your virtual environment
pip install virtualenv
virtualenv venv
  • Install requirements
pip install -r requirements.txt
  • Create new database (by default it's Mysql) and set its parametrs in config.py
  • Run project, just uncomment app.run in run.py before.
python run.py

Also you can use flask command in terminal. Therefore you shouldn't uncomment app.run line. You should type

set FLASK_APP = run.py
flask run

So, if you'll use flask shell command, all app environment (like DB) are loaded already.

About

A tool with WEB-interface to collect scrapers and observe data you need. Using Flask.

Resources

Stars

1 star

Watchers

1 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors