A scrapy web crawler to scrape player's states from www.fifaindex.com
- python 3
- Scrapy 2.4
pip3 install -r requirements.txt
A player item has 60 attributs
- Player's overall and potential, height and weight (cm, Kg)
- Player's preferred positions, weak foot and skill moves (out of 5 stars)
- Player's preferred foot (R/L)
- Player's birthdate and age
- Player's value and wage (€)
- Player's Nation (position and kit number) and Club (position, kit number, date joined and contract length)
- Ball skills (ball control, dribbling)
- Defence (marking, slide tackle and stand tackle)
- Mental (agression, reactions, att. position, interceptions, vision and composure)
- Passing (crossing, short pass and long pass)
- Physical (acceleration, stamina, strength, balance, sprint speed, agility and jumping)
- Shooting (heading, shot power, finishing, long shot, curve, FK acc., penalties and volleys)
- Goalkeeper (GK positioning, GK diving, GK kicking and GK reflexes)
- Player's Specialities
- Player's traites
cd FifaIndex
scrapy crawl players
cd FifaIndex
scrapy crawl players -a link="https://www.fifaindex.com/players/fifa16/"
cd FifaIndex
scrapy crawl players -o out.csv
The players spider used to generate the following dataset
MIT