Eiji

Eiji

Hound does not work in mix task from normal console

The problem

In our scraping project we need to use hound (for only one scraper) and we want to run all scrapers in it at same time (by flow dependency). Only one scraper (that works in console) fails when running scraper. I created a smallest example to reproduce my problem.

Environment

Elixir and Erlang versions (both installed by asdf):

elixir -v
Erlang/OTP 19 [erts-8.3.1] [source] [64-bit] [smp:4:4] [async-threads:10] [hipe] [kernel-poll:false]

Elixir 1.4.2

Deps tree:

mix deps.tree
example
└── hound ~> 1.0 (Hex package)
    ├── hackney ~> 1.5 (Hex package)
    │   ├── certifi 1.2.1 (Hex package)
    │   ├── idna 5.0.2 (Hex package)
    │   │   └── unicode_util_compat 0.2.0 (Hex package)
    │   ├── metrics 1.0.1 (Hex package)
    │   ├── mimerl 1.0.2 (Hex package)
    │   └── ssl_verify_fun 1.1.1 (Hex package)
    └── poison >= 1.4.0 (Hex package)

Steps to reproduce:

1 create new project like: mix new example
2 add hound to dependencies and run mix deps.get
3 add to configuration: config :hound, driver: "phantomjs" (this is current configuration in our real project)
4 add mix task like:

defmodule Mix.Tasks.Example do
  use Mix.Task

  def run(_args) do
    Hound.start_session
    Hound.end_session
  end
end

5 run phantomjs with --wd argument
6 run example task like: mix example

Current behavior:

  1. Running elixir console for current project iex -S mix and running scraper Mix.Tasks.Example.run([]) works and returns :ok atom
  2. Running task like mix example raise:
** (ArgumentError) argument error
    (stdlib) :ets.lookup(Hound.SessionServer, #PID<0.71.0>)
    lib/hound/session_server.ex:19: Hound.SessionServer.current_session_id/1
    lib/hound/session_server.ex:13: Hound.SessionServer.session_for_pid/2
    lib/mix/tasks/example.ex:5: Mix.Tasks.Example.run/1
    (mix) lib/mix/task.ex:294: Mix.Task.run_task/3
    (mix) lib/mix/cli.ex:58: Mix.CLI.run_task/2

Expected behavior:

In both cases (running task from iex and running task from normal console) should work and return :ok atom.

Am I forgot about something or it’s a bug in hound?

Marked As Solved

NobbZ

NobbZ

Your application is not started for tasks, if you need it started you have to do it yourself. iex -S mix does start your application, that’s why it works from there.

Also Liked

Eiji

Eiji

@NobbZ: Thank you :slight_smile:

It is always darkest before the dawn.

Where Next?

Popular in Questions Top

JDanielMartinez
Hi! May someone helps me, please! I have two apps into an umbrella project: the first one is Database, which manages queries, and the se...
New
openscript
Hello! Sorry for this astonishing simple question, but I’m really stuck. I try to set up the intellij-elixir plugin, but I don’t know ho...
New
jononomo
I am trying to figure out how Mix knows whether the environment is test, dev, or prod -- where is this set? Thanks.
New
sacepums
Hey guys. I'm new to elixir and im really stocked about it. But I ran into a bit of problem - I need to convert a date sting, for examp...
New
vac
Hi, I'm quite new in Elixir and I'm trying to format a string to a PEM format. I have the certificate value like MIIDBTCCAe2...... and ...
New
myronmarston
The Elixir Typespec docs show the following syntax for keyword lists in typespecs: # ... | [key: type] # keyword lis...
New
rms.mrcs
Hi, I need to transform a list of numbers into a map where the keys are the indexes and the values are the original values of the list....
New
johnnyicon
Hi all, I've just started learning Elixir and Phoenix Framework, so please pardon my n00bness at this stage. I'm trying to use Postg...
New
WestKeys
Currently suffering from paralysis by [HTTP client] analysis. This is rather unusual in Elixirland as there tends to be consensus on the ...
New
jc00ke
Expanding on this topic: https://forum.elixirforum.net/t/map-typespec-question/19217 Let’s say I have a map with required and optional k...
New

Other popular topics Top

JDanielMartinez
Hi! May someone helps me, please! I have two apps into an umbrella project: the first one is Database, which manages queries, and the se...
New
sorentwo
Hello! tl;dr Announcing Oban, an Ecto based job processing library with a focus on reliability and historical observability. After spen...
977 41022 311
New
senggen
Erlang/OTP 25 [erts-13.2.2] [source] [64-bit] [smp:8:8] [ds:8:8:10] [async-threads:1] 15:22:35.803 [error] gen_event {lager_file_backend...
New
itssasanka
Hi all, Trying to get some more clarity over utc_datetime and naive_datetime for Ecto: https://hexdocs.pm/ecto/Ecto.Schema.html#module-...
New
Harrisonl
We have an ECS cluster with 4 services, where each task joins a single cluster, via discovery ECS discovery service. Currently when I de...
New
fireproofsocks
I’m working on defining a simple Ecto schema for a table (in PostGres), but I don’t see where I can define a column as NOT NULL. Conside...
New
chrismccord
As promised, the first release candidate of Phoenix 1.3.0 is out! This release focuses on code generators with improved project structure...
New
minhajuddin
I have seen a lot of code which picks the first element from a list using Enum.at(0) instead of List.first. Is there a reason why people ...
New
stefanluptak
Hello everybody, usually, I use a 29" ultra-wide monitor for VSCode which can easily accomodate explorer (files panel) + file with code ...
New
lucidguppy
I have a super simple question about elixir - how would I take a file like this foo bar baz and output a new file that enumerates th...
New

We're in Beta

About us Mission Statement