Re: [PATCH] Remove #:streaming? #t from HTTP requests to fix JSON parsing

[Arun Isaac <arunisaac@systemreboot.net>]

Hi jgart,

I don't think guile does automatic gzip decompression regardless of
#:streaming?. Here's a snippet below that tests guile's http-get against
the /gzip endpoint of the https://httpbin.org/ service. In both cases, I
get a bytevector. That means, there is no gzip decompression either way.

(use-modules (web client)
             (srfi srfi-71)
             (rnrs io ports))

(let ((response body (http-get "https://httpbin.org/gzip")))
  (pk body))

(let ((response body (http-get "https://httpbin.org/gzip"
                               #:streaming? #t)))
  (pk (get-bytevector-all body)))

Could you provide more details about which LLM provider you were using
and how you ran into the bug with the invalid JSON error?

> I also noticed that openai-models was working around this with an
> accept-encoding: identity header.

I'm not sure what workaround you are referring to.

Thanks,
Arun