Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

jaydorsey/elixir_scraper

Open more actions menu

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Scraper

A simple Elixir scraper demo. This logs into a utility account & navigates you to the history page. Just an example of using Elixir/Hound to scrape a website along with some custom Chrome options

# Clone this repo, then:
brew install elixir # installs erlang & elixir
brew install rust # for compiling html5ever
brew install chromedriver
mix local.hex # installs hex

export DOM_USERNAME="username"
export DOM_PASSWORD="password"

mix deps.get # get dependencies

# Compile & run the application
iex -S mix

From the iex REPL:

Scraper.start

# Do your stuff in iex here
# Use recompile() to live recompile changes to your module

Scraper.stop # close browser

References & reading

About

Elixir/Hound web scraper example

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

Morty Proxy This is a proxified and sanitized view of the page, visit original site.