req-1.2.1: Easy-to-use, type-safe, expandable, high-level HTTP client library

Copyright© 2016–2018 Mark Karpov
LicenseBSD 3 clause
MaintainerMark Karpov <markkarpov92@gmail.com>
Stabilityexperimental
Portabilityportable
Safe HaskellNone
LanguageHaskell2010

Network.HTTP.Req

Contents

Description

The documentation below is structured in such a way that the most important information is presented first: you learn how to do HTTP requests, how to embed them in any monad you have, and then it gives you details about less-common things you may want to know about. The documentation is written with sufficient coverage of details and examples, and it's designed to be a complete tutorial on its own.

(A modest intro goes here, click on req to start making requests.)

About the library

Req is an easy-to-use, type-safe, expandable, high-level HTTP client library that just works without any fooling around.

What does the phrase “easy-to-use” mean? It means that the library is designed to be beginner-friendly so it's simple to add to your monad stack, intuitive to work with, well-documented, and does not get in your way. Doing HTTP requests is a common task and a Haskell library for this should be very approachable and clear to beginners, thus certain compromises were made. For example, one cannot currently modify ManagerSettings of the default manager because the library always uses the same implicit global manager for simplicity and maximal connection sharing. There is a way to use your own manager with different settings, but it requires a bit more typing.

“Type-safe” means that the library is protective and eliminates certain classes of errors. For example, we have correct-by-construction Urls, it's guaranteed that the user does not send the request body when using methods like GET or OPTIONS, and the amount of implicit assumptions is minimized by making the user specify his/her intentions in an explicit form (for example, it's not possible to avoid specifying the body or method of a request). Authentication methods that assume HTTPS force the user to use HTTPS at the type level. The library also carefully hides underlying types from the lower-level http-client package because those types are not safe enough (for example Request is an instance of IsString and, if it's malformed, it will blow up at run-time).

“Expandable” refers to the ability of the library to be expanded without having to resort to ugly hacking. For example, it's possible to define your own HTTP methods, create new ways to construct the body of a request, create new authorization options, perform a request in a different way, and create your own methods to parse and represent a response. As a user extends the library to satisfy his/her special needs, the new solutions will work just like the built-ins. However, all of the common cases are also covered by the library out-of-the-box.

“High-level” means that there are less details to worry about. The library is a result of my experiences as a Haskell consultant. Working for several clients, who had very different projects, showed me that the library should adapt easily to any particular style of writing Haskell applications. For example, some people prefer throwing exceptions, while others are concerned with purity. Just define handleHttpException accordingly when making your monad instance of MonadHttp and it will play together seamlessly. Finally, the library cuts boilerplate down considerably, and helps you write concise, easy to read, and maintainable code.

Using with other libraries

  • You won't need the low-level interface of http-client most of the time, but when you do, it's better to do a qualified import, because http-client has naming conflicts with req.
  • For streaming of large request bodies see the companion package req-conduit: https://hackage.haskell.org/package/req-conduit.

Lightweight, no risk solution

The library uses the following mature packages under the hood to guarantee you the best experience:

It's important to note that since we leverage well-known libraries that the whole Haskell ecosystem uses, there is no risk in using req. The machinery for performing requests is the same as with http-conduit and wreq. The only difference is the API.

Synopsis

Making a request

To make an HTTP request you normally need only one function: req.

req Source #

Arguments

:: (MonadHttp m, HttpMethod method, HttpBody body, HttpResponse response, HttpBodyAllowed (AllowsBody method) (ProvidesBody body)) 
=> method

HTTP method

-> Url scheme

Url—location of resource

-> body

Body of the request

-> Proxy response

A hint how to interpret response

-> Option scheme

Collection of optional parameters

-> m response

Response

Make an HTTP request. The function takes 5 arguments, 4 of which specify required parameters and the final Option argument is a collection of optional parameters.

Let's go through all the arguments first: req method url body response options.

method is an HTTP method such as GET or POST. The documentation has a dedicated section about HTTP methods below.

url is a Url that describes location of resource you want to interact with.

body is a body option such as NoReqBody or ReqBodyJson. The tutorial has a section about HTTP bodies, but usage is very straightforward and should be clear from the examples below.

response is a type hint how to make and interpret response of an HTTP request. Out-of-the-box it can be the following:

Finally, options is a Monoid that holds a composite Option for all other optional settings like query parameters, headers, non-standard port number, etc. There are quite a few things you can put there, see the corresponding section in the documentation. If you don't need anything at all, pass mempty.

Note that if you use req to do all your requests, connection sharing and reuse is done for you automatically.

See the examples below to get on the speed quickly.

Examples

Expand

First, this is a piece of boilerplate that should be in place before you try the examples:

{-# LANGUAGE OverloadedStrings #-}

module Main (main) where

import Control.Monad
import Control.Monad.IO.Class
import Data.Aeson
import Data.Default.Class
import Data.Maybe (fromJust)
import Data.Monoid ((<>))
import Data.Text (Text)
import GHC.Generics
import Network.HTTP.Req
import qualified Data.ByteString.Char8 as B

We will be making requests against the https://httpbin.org service.

Make a GET request, grab 5 random bytes:

main :: IO ()
main = runReq def $ do
  let n :: Int
      n = 5
  bs <- req GET (https "httpbin.org" /: "bytes" /~ n) NoReqBody bsResponse mempty
  liftIO $ B.putStrLn (responseBody bs)

The same, but now we use a query parameter named "seed" to control seed of the generator:

main :: IO ()
main = runReq def $ do
  let n, seed :: Int
      n    = 5
      seed = 100
  bs <- req GET (https "httpbin.org" /: "bytes" /~ n) NoReqBody bsResponse $
    "seed" =: seed
  liftIO $ B.putStrLn (responseBody bs)

POST JSON data and get some info about the POST request:

data MyData = MyData
  { size  :: Int
  , color :: Text
  } deriving (Show, Generic)

instance ToJSON MyData
instance FromJSON MyData

main :: IO ()
main = runReq def $ do
  let myData = MyData
        { size  = 6
        , color = "Green" }
  v <- req POST (https "httpbin.org" /: "post") (ReqBodyJson myData) jsonResponse mempty
  liftIO $ print (responseBody v :: Value)

Sending URL-encoded body:

main :: IO ()
main = runReq def $ do
  let params =
        "foo" =: ("bar" :: Text) <>
        queryFlag "baz"
  response <- req POST (https "httpbin.org" /: "post") (ReqBodyUrlEnc params) jsonResponse mempty
  liftIO $ print (responseBody response :: Value)

Using various optional parameters and URL that is not known in advance:

main :: IO ()
main = runReq def $ do
  -- This is an example of what to do when URL is given dynamically. Of
  -- course in a real application you may not want to use 'fromJust'.
  let (url, options) = fromJust (parseUrlHttps "https://httpbin.org/get?foo=bar")
  response <- req GET url NoReqBody jsonResponse $
    "from" =: (15 :: Int)           <>
    "to"   =: (67 :: Int)           <>
    basicAuth "username" "password" <>
    options                         <> -- contains the ?foo=bar part
    port 443 -- here you can put any port of course
  liftIO $ print (responseBody response :: Value)

reqBr Source #

Arguments

:: (MonadHttp m, HttpMethod method, HttpBody body, HttpBodyAllowed (AllowsBody method) (ProvidesBody body)) 
=> method

HTTP method

-> Url scheme

Url—location of resource

-> body

Body of the request

-> Option scheme

Collection of optional parameters

-> (Response BodyReader -> IO a)

How to consume response

-> m a

Result

A version of req that does not use one of the predefined instances of HttpResponse but instead allows the user to consume Response BodyReader manually, in a custom way.

Since: req-1.0.0

req' Source #

Arguments

:: (MonadHttp m, HttpMethod method, HttpBody body, HttpBodyAllowed (AllowsBody method) (ProvidesBody body)) 
=> method

HTTP method

-> Url scheme

Url—location of resource

-> body

Body of the request

-> Option scheme

Collection of optional parameters

-> (Request -> Manager -> m a)

How to perform request

-> m a

Result

Mostly like req with respect to its arguments, but accepts a callback that allows to perform a request in arbitrary fashion.

This function does not perform handling/wrapping exceptions, checking response (with httpConfigCheckResponse), and retrying. It only prepares Request and allows you to use it.

Since: req-0.3.0

withReqManager :: MonadIO m => (Manager -> m a) -> m a Source #

Perform an action using the global implicit Manager that the rest of the library uses. This allows to reuse connections that the Manager controls.

Embedding requests into your monad

To use req in your monad, all you need to do is to make the monad an instance of the MonadHttp type class.

When writing a library, keep your API polymorphic in terms of MonadHttp, only define instance of MonadHttp in final application. Another option is to use newtype wrapped monad stack and define MonadHttp for it. As of version 0.4.0, the Req monad that follows this strategy is provided out-of-the-box (see below).

class MonadIO m => MonadHttp m where Source #

A type class for monads that support performing HTTP requests. Typically, you only need to define the handleHttpException method unless you want to tweak HttpConfig.

Minimal complete definition

handleHttpException

Methods

handleHttpException :: HttpException -> m a Source #

This method describes how to deal with HttpException that was caught by the library. One option is to re-throw it if you are OK with exceptions, but if you prefer working with something like MonadError, this is the right place to pass it to throwError.

getHttpConfig :: m HttpConfig Source #

Return HttpConfig to be used when performing HTTP requests. Default implementation returns its def value, which is described in the documentation for the type. Common usage pattern with manually defined getHttpConfig is to return some hard-coded value, or a value extracted from MonadReader if a more flexible approach to configuration is desirable.

data HttpConfig Source #

HttpConfig contains general and default settings to be used when making HTTP requests.

Constructors

HttpConfig 

Fields

  • httpConfigProxy :: Maybe Proxy

    Proxy to use. By default values of HTTP_PROXY and HTTPS_PROXY environment variables are respected, this setting overwrites them. Default value: Nothing.

  • httpConfigRedirectCount :: Int

    How many redirects to follow when getting a resource. Default value: 10.

  • httpConfigAltManager :: Maybe Manager

    Alternative Manager to use. Nothing (default value) means that the default implicit manager will be used (that's what you want in 99% of cases).

  • httpConfigCheckResponse :: forall b. Request -> Response b -> ByteString -> Maybe HttpExceptionContent

    Function to check the response immediately after receiving the status and headers, before streaming of response body. The third argument is the beginning of response body (typically first 1024 bytes). This is used for throwing exceptions on non-success status codes by default (set to \_ _ _ -> Nothing if this behavior is not desirable).

    When the value this function returns is Nothing, nothing will happen. When it there is HttpExceptionContent inside Just, it will be thrown.

    Throwing is better then just returning a request with non-2xx status code because in that case something is wrong and we need a way to short-cut execution (also remember that Req retries automatically on request timeouts and such, so when your request fails, it's certainly something exceptional). The thrown exception is caught by the library though and is available in handleHttpException.

    Note: signature of this function was changed in the version 1.0.0.

    Since: req-0.3.0

  • httpConfigRetryPolicy :: RetryPolicy

    The retry policy to use for request retrying. By default def is used (see RetryPolicyM).

    Note: signature of this function was changed in the version 1.0.0.

    Since: req-0.3.0

  • httpConfigRetryJudge :: forall b. RetryStatus -> Response b -> Bool

    The function is used to decide whether to retry a request. True means that the request should be retried.

    Note: signature of this function was changed in the version 1.0.0.

    Since: req-0.3.0

Instances
Default HttpConfig Source # 
Instance details

Defined in Network.HTTP.Req

Methods

def :: HttpConfig #

data Req a Source #

A monad that allows to run req in any IO-enabled monad without having to define new instances.

Since: req-0.4.0

Instances
Monad Req Source # 
Instance details

Defined in Network.HTTP.Req

Methods

(>>=) :: Req a -> (a -> Req b) -> Req b #

(>>) :: Req a -> Req b -> Req b #

return :: a -> Req a #

fail :: String -> Req a #

Functor Req Source # 
Instance details

Defined in Network.HTTP.Req

Methods

fmap :: (a -> b) -> Req a -> Req b #

(<$) :: a -> Req b -> Req a #

Applicative Req Source # 
Instance details

Defined in Network.HTTP.Req

Methods

pure :: a -> Req a #

(<*>) :: Req (a -> b) -> Req a -> Req b #

liftA2 :: (a -> b -> c) -> Req a -> Req b -> Req c #

(*>) :: Req a -> Req b -> Req b #

(<*) :: Req a -> Req b -> Req a #

MonadIO Req Source # 
Instance details

Defined in Network.HTTP.Req

Methods

liftIO :: IO a -> Req a #

MonadHttp Req Source # 
Instance details

Defined in Network.HTTP.Req

MonadBase IO Req Source # 
Instance details

Defined in Network.HTTP.Req

Methods

liftBase :: IO α -> Req α #

MonadBaseControl IO Req Source # 
Instance details

Defined in Network.HTTP.Req

Associated Types

type StM Req a :: * #

Methods

liftBaseWith :: (RunInBase Req IO -> IO a) -> Req a #

restoreM :: StM Req a -> Req a #

type StM Req a Source # 
Instance details

Defined in Network.HTTP.Req

type StM Req a = a

runReq Source #

Arguments

:: MonadIO m 
=> HttpConfig

HttpConfig to use

-> Req a

Computation to run

-> m a 

Run a computation in the Req monad with the given HttpConfig. In case of exceptional situation an HttpException will be thrown.

Since: req-0.4.0

Request

Method

The package supports all methods as defined by RFC 2616, and PATCH which is defined by RFC 5789—that should be enough to talk to RESTful APIs. In some cases, however, you may want to add more methods (e.g. you work with WebDAV https://en.wikipedia.org/wiki/WebDAV); no need to compromise on type safety and hack, it only takes a couple of seconds to define a new method that will works seamlessly, see HttpMethod.

data GET Source #

GET method.

Constructors

GET 
Instances
HttpMethod GET Source # 
Instance details

Defined in Network.HTTP.Req

Associated Types

type AllowsBody GET :: CanHaveBody Source #

type AllowsBody GET Source # 
Instance details

Defined in Network.HTTP.Req

data POST Source #

POST method.

Constructors

POST 
Instances
HttpMethod POST Source # 
Instance details

Defined in Network.HTTP.Req

Associated Types

type AllowsBody POST :: CanHaveBody Source #

type AllowsBody POST Source # 
Instance details

Defined in Network.HTTP.Req

data HEAD Source #

HEAD method.

Constructors

HEAD 
Instances
HttpMethod HEAD Source # 
Instance details

Defined in Network.HTTP.Req

Associated Types

type AllowsBody HEAD :: CanHaveBody Source #

type AllowsBody HEAD Source # 
Instance details

Defined in Network.HTTP.Req

data PUT Source #

PUT method.

Constructors

PUT 
Instances
HttpMethod PUT Source # 
Instance details

Defined in Network.HTTP.Req

Associated Types

type AllowsBody PUT :: CanHaveBody Source #

type AllowsBody PUT Source # 
Instance details

Defined in Network.HTTP.Req

data DELETE Source #

DELETE method. This data type does not allow having request body with DELETE requests, as it should be. However some APIs may expect DELETE requests to have bodies, in that case define your own variation of DELETE method and allow it to have a body.

Constructors

DELETE 
Instances
HttpMethod DELETE Source # 
Instance details

Defined in Network.HTTP.Req

Associated Types

type AllowsBody DELETE :: CanHaveBody Source #

type AllowsBody DELETE Source # 
Instance details

Defined in Network.HTTP.Req

data TRACE Source #

TRACE method.

Constructors

TRACE 
Instances
HttpMethod TRACE Source # 
Instance details

Defined in Network.HTTP.Req

Associated Types

type AllowsBody TRACE :: CanHaveBody Source #

type AllowsBody TRACE Source # 
Instance details

Defined in Network.HTTP.Req

data CONNECT Source #

CONNECT method.

Constructors

CONNECT 
Instances
HttpMethod CONNECT Source # 
Instance details

Defined in Network.HTTP.Req

Associated Types

type AllowsBody CONNECT :: CanHaveBody Source #

type AllowsBody CONNECT Source # 
Instance details

Defined in Network.HTTP.Req

data OPTIONS Source #

OPTIONS method.

Constructors

OPTIONS 
Instances
HttpMethod OPTIONS Source # 
Instance details

Defined in Network.HTTP.Req

Associated Types

type AllowsBody OPTIONS :: CanHaveBody Source #

type AllowsBody OPTIONS Source # 
Instance details

Defined in Network.HTTP.Req

data PATCH Source #

PATCH method.

Constructors

PATCH 
Instances
HttpMethod PATCH Source # 
Instance details

Defined in Network.HTTP.Req

Associated Types

type AllowsBody PATCH :: CanHaveBody Source #

type AllowsBody PATCH Source # 
Instance details

Defined in Network.HTTP.Req

class HttpMethod a where Source #

A type class for types that can be used as an HTTP method. To define a non-standard method, follow this example that defines COPY:

data COPY = COPY

instance HttpMethod COPY where
  type AllowsBody COPY = 'CanHaveBody
  httpMethodName Proxy = "COPY"

Minimal complete definition

httpMethodName

Associated Types

type AllowsBody a :: CanHaveBody Source #

Type function AllowsBody returns a type of kind CanHaveBody which tells the rest of the library whether the method can have a body or not. We use the special type CanHaveBody lifted to the kind level instead of Bool to get more user-friendly compiler messages.

Methods

httpMethodName :: Proxy a -> ByteString Source #

Return name of the method as a ByteString.

Instances
HttpMethod PATCH Source # 
Instance details

Defined in Network.HTTP.Req

Associated Types

type AllowsBody PATCH :: CanHaveBody Source #

HttpMethod OPTIONS Source # 
Instance details

Defined in Network.HTTP.Req

Associated Types

type AllowsBody OPTIONS :: CanHaveBody Source #

HttpMethod CONNECT Source # 
Instance details

Defined in Network.HTTP.Req

Associated Types

type AllowsBody CONNECT :: CanHaveBody Source #

HttpMethod TRACE Source # 
Instance details

Defined in Network.HTTP.Req

Associated Types

type AllowsBody TRACE :: CanHaveBody Source #

HttpMethod DELETE Source # 
Instance details

Defined in Network.HTTP.Req

Associated Types

type AllowsBody DELETE :: CanHaveBody Source #

HttpMethod PUT Source # 
Instance details

Defined in Network.HTTP.Req

Associated Types

type AllowsBody PUT :: CanHaveBody Source #

HttpMethod HEAD Source # 
Instance details

Defined in Network.HTTP.Req

Associated Types

type AllowsBody HEAD :: CanHaveBody Source #

HttpMethod POST Source # 
Instance details

Defined in Network.HTTP.Req

Associated Types

type AllowsBody POST :: CanHaveBody Source #

HttpMethod GET Source # 
Instance details

Defined in Network.HTTP.Req

Associated Types

type AllowsBody GET :: CanHaveBody Source #

URL

We use Urls which are correct by construction, see Url. To build a Url from a ByteString, use parseUrlHttp, parseUrlHttps, or generic parseUrl.

data Url (scheme :: Scheme) Source #

Request's Url. Start constructing your Url with http or https specifying the scheme and host at the same time. Then use the (/~) and (/:) operators to grow the path one piece at a time. Every single piece of path will be url(percent)-encoded, so using (/~) and (/:) is the only way to have forward slashes between path segments. This approach makes working with dynamic path segments easy and safe. See examples below how to represent various Urls (make sure the OverloadedStrings language extension is enabled).

Examples

Expand
http "httpbin.org"
-- http://httpbin.org
https "httpbin.org"
-- https://httpbin.org
https "httpbin.org" /: "encoding" /: "utf8"
-- https://httpbin.org/encoding/utf8
https "httpbin.org" /: "foo" /: "bar/baz"
-- https://httpbin.org/foo/bar%2Fbaz
https "httpbin.org" /: "bytes" /~ (10 :: Int)
-- https://httpbin.org/bytes/10
https "юникод.рф"
-- https://%D1%8E%D0%BD%D0%B8%D0%BA%D0%BE%D0%B4.%D1%80%D1%84
Instances
Eq (Url scheme) Source # 
Instance details

Defined in Network.HTTP.Req

Methods

(==) :: Url scheme -> Url scheme -> Bool #

(/=) :: Url scheme -> Url scheme -> Bool #

Typeable scheme => Data (Url scheme) Source # 
Instance details

Defined in Network.HTTP.Req

Methods

gfoldl :: (forall d b. Data d => c (d -> b) -> d -> c b) -> (forall g. g -> c g) -> Url scheme -> c (Url scheme) #

gunfold :: (forall b r. Data b => c (b -> r) -> c r) -> (forall r. r -> c r) -> Constr -> c (Url scheme) #

toConstr :: Url scheme -> Constr #

dataTypeOf :: Url scheme -> DataType #

dataCast1 :: Typeable t => (forall d. Data d => c (t d)) -> Maybe (c (Url scheme)) #

dataCast2 :: Typeable t => (forall d e. (Data d, Data e) => c (t d e)) -> Maybe (c (Url scheme)) #

gmapT :: (forall b. Data b => b -> b) -> Url scheme -> Url scheme #

gmapQl :: (r -> r' -> r) -> r -> (forall d. Data d => d -> r') -> Url scheme -> r #

gmapQr :: (r' -> r -> r) -> r -> (forall d. Data d => d -> r') -> Url scheme -> r #

gmapQ :: (forall d. Data d => d -> u) -> Url scheme -> [u] #

gmapQi :: Int -> (forall d. Data d => d -> u) -> Url scheme -> u #

gmapM :: Monad m => (forall d. Data d => d -> m d) -> Url scheme -> m (Url scheme) #

gmapMp :: MonadPlus m => (forall d. Data d => d -> m d) -> Url scheme -> m (Url scheme) #

gmapMo :: MonadPlus m => (forall d. Data d => d -> m d) -> Url scheme -> m (Url scheme) #

Ord (Url scheme) Source # 
Instance details

Defined in Network.HTTP.Req

Methods

compare :: Url scheme -> Url scheme -> Ordering #

(<) :: Url scheme -> Url scheme -> Bool #

(<=) :: Url scheme -> Url scheme -> Bool #

(>) :: Url scheme -> Url scheme -> Bool #

(>=) :: Url scheme -> Url scheme -> Bool #

max :: Url scheme -> Url scheme -> Url scheme #

min :: Url scheme -> Url scheme -> Url scheme #

Show (Url scheme) Source # 
Instance details

Defined in Network.HTTP.Req

Methods

showsPrec :: Int -> Url scheme -> ShowS