Ask Ubuntu
Ask Ubuntu

Questions tagged [wget]

GNU Wget (or just wget) is a command line-based program for downloading content from the Internet using HTTP, HTTPS and FTP.

GNU Wget is a command-line program that can be invoked from the command-line using wget. It several different options available from the command-line, (including -c, -O, --output-document=, -t, --tries=, etc.) to see a list of them all run wget -h from the command-line.

External links

502 questions
292
votes
6 answers

How do I provide a username and password to wget?

I've tried to connect to a server via wget: wget http://:@serveradress But wget responds: invalid port I know that the server accepts incoming traffic at port 80. How can I fix this issue?
pschmidt
  • 3,889
165
votes
8 answers

Download files from a list

How can I download files (that are listed in a text file) using wget or some other automatic way? Sample file list: www.example.com/1.pdf www.example.com/2.pdf www.example.com/3.pdf
Sourav
  • 2,325
75
votes
2 answers

How to make wget faster or multithreading?

I've just upgraded my computer hardware(cpu + motherboard + graphic card + memory + hard disk), so that install a new OS is needed. I tried to download debian-6.0.6-amd64-netinst.iso with wget command but the speed is so slow that I could not bear.…
Teifi
  • 1,332
74
votes
9 answers

How do I use wget/curl to download from a site I am logged into?

Some parts of wikipedia appear differently when you're logged in. I would like to wget user pages so they would appear as if I was logged in. Is there a way I can wget user pages like this http://en.wikipedia.org/wiki/User:A this is the login…
user784637
  • 11,465
60
votes
5 answers

Download a whole website with wget (or other) including all its downloadable content

I'm trying to download winamp's website in case they shut it down. I need to download literally everything. I tried once with wget and I managed to download the website itself, but when I try to download any file from it it gives a file without an…
842Mono
  • 10,070
56
votes
3 answers

Force wget to use actual filename

When using wget in a script to download some files from Google Docs, the name of the file is not preserved. For example: wget 'http://spreadsheets.google.com/pub?key=pyj6tScZqmEfbZyl0qjbiRQ&output=xls' saves the file as…
Chinmay Kanchi
  • 921
48
votes
4 answers

How to get WGET to download exact same web page html as browser

Using a web browser (IE or Chrome) I can save a web page (.html) with Ctl-S, inspect it with any text editor, and see data in a table format. One of those numbers I want to extract, but for many, many web pages, too many to do manually. So I'd like…
user239598
  • 481
45
votes
4 answers

What is the difference between curl and wget?

Both of these curl and wget are use for downloading files, etc. What are the notable differences one might take in account in order chose one over the other?
snoop
  • 4,110
  • 9
  • 41
  • 58
39
votes
6 answers

How to verify the SSL fingerprint by command line? (wget, curl, ...)

Using a command line website downloader, such as wget, curl or any other one... In a script... I have the SHA-1 and the SHA-256 certficate fingerprint of a website. Due to security concerns (1) (2), I don't want to use the public SSL certificate…
James Mitch
  • 1
35
votes
3 answers

bash: syntax error near unexpected token `('

I am trying to download flareget download manager via wget I get error wget http://www.flareget.com/files/flareget/debs/amd64/flareget_2.3-24_amd64(stable)_deb.tar.gz bash: syntax error near unexpected token `(' Why is that error coming and what…
Registered User
  • 5,174
34
votes
2 answers

gzip: stdin: not in gzip format

When I run: tar -zxvf john-1.7.0.2.tar.gz I get this: gzip: stdin: not in gzip format tar: Child returned status 1 tar: Error is not recoverable: exiting now It should start unpacking. Some people told me not to use the z but I get the same…
Red fusion team
  • 441
32
votes
5 answers

How do I force wget to use a proxy server without modifying system files?

I'd like to know an equivalent to wget enabling me to set the proxy while calling the command (like wget --proxy=$http_proxy). Any ideas ?
merours
  • 425
32
votes
1 answer

`curl -O` stores an empty file though `wget` works well

I have tried to download a file from https://logz.io/sample-data. curl -O https://logz.io/sample-data However, it just returns an empty file named sample-data. In contrast to curl, however, wget works well returning a file containing proper…
user3523935
  • 455
  • 2
  • 6
  • 10
30
votes
2 answers

This command can only be used by root

I'm on Ubuntu 16 and I'd like to add a neo4j package. I tried in 3 ways all leading to the same error. These are my attempts: wget -O - http://debian.neo4j.org/neotechnology.gpg.key | apt-key add - sudo wget -O -…
splunk
  • 403
27
votes
2 answers

How to determine the HTTP status without downloading the complete page?

I want to know the HTTP Status of the websites using Ubuntu. I have used curl and wget command for that purpose. But the problem is these commands download the complete website page and then search for the header and display it on the screen. For…
Jaffer Wilson
  • 1,588
1
2 3
…
33 34