pramsky

pramsky

HTTPoison multipart post

Hello!

I have the following curl request (confirmed working)

curl --request POST \                                                                         
--url https://example.net \
--header 'Authorization: Bearer asupersecrettokentoauthenticatewith' \
--header 'Content-Type: multipart/form-data' \
--form orgid=1234567890987654321 \
--form from=5555555555 \
--form to=1234 \
--form 'file=@"/tmp/foo.png"'

I created the multipart payload and posted as as

filepath = "/tmp/foo.png"
orgid = "1234567890987654321"
from = "5555555555"
to = "1234"

form = [{:file, filepath}, {"from", from}, {"to", to}, {"orgid", orgid}]

headers = [
  "Content-Type": "multipart/form-data",
  "Authorization": "Bearer asupersecrettokentoauthenticatewith"
]

options = []

HTTPoison.post("https://example.net", {:multipart, form}, headers, options)

The HTTPoison request does not seem to work. Am I missing something in the translation ?

Thanks

Marked As Solved

al2o3cr

al2o3cr

The boundary from HTTPoison meets the requirements of RFC2046 - it’s more than 1 and less than 70 characters from the specified character set. If the vendor’s parser is breaking on it, the vendor’s parser is broken.

These logs show that the vendor’s parser might be broken (there’s no data printed from the second one) but they offer no suggestion of what the problem is. The only thing that can tell us what’s going on is the raw bytes actually sent to the server.

One way to capture these is with netcat (frequently shortened to nc) - a handy utility program that will listen on a specified port and then print exactly what comes in when invoked with -l

For curl:

Matts-MacBook-Pro-2:~ mattjones$ nc -l localhost 8888
POST / HTTP/1.1
Host: localhost:8888
User-Agent: curl/7.54.0
Accept: */*
Authorization: Bearer asupersecrettokentoauthenticatewith
Content-Length: 619
Expect: 100-continue
Content-Type: multipart/form-data; boundary=------------------------58692fd24caf27b7

--------------------------58692fd24caf27b7
Content-Disposition: form-data; name="orgid"

1234567890987654321
--------------------------58692fd24caf27b7
Content-Disposition: form-data; name="from"

5555555555
--------------------------58692fd24caf27b7
Content-Disposition: form-data; name="to"

1234
--------------------------58692fd24caf27b7
Content-Disposition: form-data; name="file"; filename="helloworld.erl"
Content-Type: application/octet-stream

% hello world program
-module(helloworld).
-export([start/0]).

start() ->
    spawn(fun() -> ok end).
--------------------------58692fd24caf27b7--

Versus the result from HTTPoison:

Matts-MacBook-Pro-2:~ mattjones$ nc -l 127.0.0.1 8888
POST / HTTP/1.1
Authorization: Bearer asupersecrettokentoauthenticatewith
Host: 127.0.0.1:8888
User-Agent: hackney/1.18.1
Content-Type: multipart/form-data; boundary=---------------------------bydneyeiuypqrgyb
Content-Length: 834

-----------------------------bydneyeiuypqrgyb
content-length: 102
content-type: application/octet-stream
content-disposition: form-data; name="file"; filename="helloworld.erl"

% hello world program
-module(helloworld).
-export([start/0]).

start() ->
    spawn(fun() -> ok end).
-----------------------------bydneyeiuypqrgyb
content-length: 10
content-type: application/octet-stream
content-disposition: form-data; name="from"

5555555555
-----------------------------bydneyeiuypqrgyb
content-length: 4
content-type: application/octet-stream
content-disposition: form-data; name="to"

1234
-----------------------------bydneyeiuypqrgyb
content-length: 19
content-type: application/octet-stream
content-disposition: form-data; name="orgid"

1234567890987654321
-----------------------------bydneyeiuypqrgyb--

Notable differences:

  • HTTPoison always sends Content-Length headers
  • HTTPoison always sends Content-Type headers

You could try passing an explicit Content-Type to the form fields; there are bug reports that suggest that some servers don’t handle application/octet-stream fields correctly. For instance, pass {"from", from, [{"content-type", "text/plain"}]} instead of {"from", from}. Doing this locally has the desired effect (the content-type values change for the form fields).

On the other hand, apparently some servers don’t like Content-Length:

Also Liked

al2o3cr

al2o3cr

Can you extract the actual contents of the two requests?

al2o3cr

al2o3cr

I don’t think comparing what comes out of HTTPBin’s parser is sufficient to see the issue - I only see two differences:

  • the boundary string in the Content-Type; that’s intentionally random and so not relevant
  • the Accept header from Curl is not present in the other

It’s worth a try to add that header; some HTTP implementations are more selective about the headers they expect.

Otherwise you’ll need the actual bytes being sent in the two requests - there’s evidently some difference, since Pipedream shows a slightly different shape, despite HTTPBin seeing the same values.

Where Next?

Popular in Questions Top

sergio
In Ruby, I can go: User.find_by(email: "foobar@email.com").update(email: "hello@email.com") How can I do something similar in Elixir? ...
New
albydarned
Hello all! I am typing this post from my new MacBook Pro with the M1 chip. I’m loving it so far, and will probably use it as my daily dr...
New
New
Werner
Hi, I’m using Ubuntu 18.04 and after updating to OTP-24.0 yesterday i have this warning when I run “mix local.hex”: 14:57:30.512 [warn] ...
New
vonH
When I run the Plug and I recompile I wind up having to use Ctrl C to quit iex and start again. Witht the help of rlwrap I can use the cu...
New
electic
Hi, I am new to Elixir. I am trying to use the DateTime component to insert a date into MySQL however the there seems to be no way to fo...
New
Fl4m3Ph03n1x
About me? ( if you have nothing better to do than reading about some random guy in the internet :stuck_out_tongue: ) Hello all, this is ...
New
sabri
Can someone explain the settings of pool_size of Ecto in config file? and what is the recommend size? Thanks
New
lucidguppy
I have a super simple question about elixir - how would I take a file like this foo bar baz and output a new file that enumerates th...
New
lanycrost
Hi everyone! I need implement if…else if…else condition from my elixir code, and anymore of this control flow structures not work proper...
New

Other popular topics Top

JakeBecker
TL;DR: I’ve just released an implementation of Microsoft’s IDE-independent Language Server Protocol for Elixir. It adds language support ...
1140 51847 244
New
joaquinalcerro
Hi there, I am working with Ecto-Postgresql and I need to call all of the records from a specific table but the table has 40,000 record...
New
jerry
Good day to you all. I have been struggling to get a query involving like and ilike to work. Can anyone assist me on this, please? pro...
New
grych
Hi folks, Few months ago I have announced the proof-of-concept of the library to manipulate the browsers DOM objects directly from Elixi...
639 49522 488
New
KronicDeth
Elixir plugin for JetBrain’s IntelliJ Platform (including Rubymine) This is a plugin that adds support for Elixir to JetBrains IntelliJ...
289 35421 110
New
Harrisonl
We have an ECS cluster with 4 services, where each task joins a single cluster, via discovery ECS discovery service. Currently when I de...
New
chrismccord
As promised, the first release candidate of Phoenix 1.3.0 is out! This release focuses on code generators with improved project structure...
New
minhajuddin
I have seen a lot of code which picks the first element from a list using Enum.at(0) instead of List.first. Is there a reason why people ...
New
WestKeys
Currently suffering from paralysis by [HTTP client] analysis. This is rather unusual in Elixirland as there tends to be consensus on the ...
New
skosch
To my knowledge, put_in, Map.update etc. all have the one limitation of not automatically creating intermediate keys when needed (for exa...
New

We're in Beta

About us Mission Statement