topic Re: curl in Tech Help - Software/Hardware etc

curl

Anonymous — Fri, 07 Mar 2025 22:53:53 GMT

C:\Users\user2>curl https://www.amazon.co.uk
Warning: Binary output can mess up your terminal. Use "--output -" to tell curl to output it to your terminal anyway,
Warning: or consider "--output <FILE>" to save to a file.

After using --output (with resultant unreadable output), the binary stuff displayed in a command line window rang my bell (after a delay of about 5-6 seconds). A ding-dong (which my mail client plays when new mail arrives). The mail client wasn't active at the time.

Trying curl with other websites over https doesn't result in the same.

Does anyone have any (technical) insight? 'Googling' amazon and curl just brings up hair curling utensils marketed on amazon.

Re: curl

Baldrick1 — Sat, 08 Mar 2025 09:37:22 GMT

Moderator's note:
Thread moved from Everything Else to Tech Help

Re: curl

TheRoadCrew — Sat, 08 Mar 2025 09:59:40 GMT

@Anonymous wrote:

[...]

Does anyone have any (technical) insight? 'Googling' amazon and curl just brings up hair curling utensils marketed on amazon.

From the curl man page:

DESCRIPTION
curl is a tool for transferring data from or to a server using URLs. It supports these protocols: DICT, FILE, FTP, FTPS, GOPHER, GOPHERS, HTTP, HTTPS, IMAP, IMAPS, LDAP, LDAPS, MQTT, POP3, POP3S, RTMP,
RTMPS, RTSP, SCP, SFTP, SMB, SMBS, SMTP, SMTPS, TELNET, TFTP, WS and WSS.

You would need to specify which data you want to transfer

Something like

curl -O https://mirror.server.net/linuxmint/iso/debian/lmde-6-cinnamon-64bit.iso

would download (transfer) that iso image.

Alternatively, I may be misunderstanding what you are asking.

Re: curl

TheRoadCrew — Sat, 08 Mar 2025 11:30:52 GMT

@TheRoadCrew wrote:

Alternatively, I may be misunderstanding what you are asking.

Actually, running

$ curl https://www.amazon.co.uk > amazon.txt

saves the output for me. Forum software won't let me attach the txt file 'cos it contains html.

Re: curl

Anonymous — Sat, 08 Mar 2025 22:26:18 GMT

running

curl https://www.amazon.co.uk > amazon.txt

Screenshot of the first page of the resultant amazon.txt

Re: curl

TheRoadCrew — Sun, 09 Mar 2025 01:36:22 GMT

I don't see any binary at all:

Odd that only Amazon behaves this way for you; don't know if why do i get binary output using curl? is relevant in this case.

Re: curl

Anonymous — Sun, 09 Mar 2025 21:25:20 GMT

It was the '--compressed' option that was the solution. Thanks.

Although I am unsure why I need to specify that when you don't. One answer often leads to more questions.

Re: curl

TheRoadCrew — Mon, 10 Mar 2025 23:02:14 GMT

@Anonymous wrote:

[...]

Although I am unsure why I need to specify that when you don't.

If you are using curl shipped by Microsoft perhaps it has something to do with the curl alias (if it still exists).

Re: curl

Townman — Tue, 11 Mar 2025 08:35:46 GMT

Could this be the difference between running in Poweshell vs a CMD prompt?

Re: curl

Anonymous — Tue, 11 Mar 2025 22:16:51 GMT

Dunno, but I'll give it a test later. (This will only be under Win10. Whether there's a difference under Win11 I may never find out).

I'll go back and give Roadcrew a 'fix'. In the dim and distant past I've come across gflate(?) in HTTP and that had been relegated to the back of my brain into the 'use it or lose it' category.

Re: curl

Anonymous — Tue, 11 Mar 2025 22:28:27 GMT

It appears that a momentary warning(?) flashes up (in yellow, before disappearing) in Powershell (both as a 'normal' user and as an admin), then it appears that powershell automagically tries the --compressed option.