리눅스 wget 정리

wget 기능

■ 브라우저에서 다운로드 하는 것 처럼 user-agent 정보 보내기

$ wget http://contoso.com/

해당 주소에서 막아놔서 다운로드 받으려 하면 에러

--2021-12-15 14:23:22--  http://contoso.com/

Resolving contoso.com (contoso.com)... 104.215.148.63, 40.112.72.205, 13.77.161.179, ...

Connecting to contoso.com (contoso.com)|104.215.148.63|:80... connected.

HTTP request sent, awaiting response... 301 Moved Permanently

Location: https://www.microsoft.com/ms.htm [following]

--2021-12-15 14:23:22--  https://www.microsoft.com/ms.htm

Resolving www.microsoft.com (www.microsoft.com)... 104.109.241.178, 2600:1410:4000:192::356e, 2600:1410:4000:18f::356e, ...

Connecting to www.microsoft.com (www.microsoft.com)|104.109.241.178|:443... connected.

HTTP request sent, awaiting response... 403 Forbidden

2021-12-15 14:23:22 ERROR 403: Forbidden.

 

$ wget --user-agent="User-info" http://contoso.com/

해당 주소에 user-agent 보내고 다운로드 함

--2021-12-15 14:23:09--  http://contoso.com/

Resolving contoso.com (contoso.com)... 13.77.161.179, 40.76.4.15, 40.113.200.201, ...

Connecting to contoso.com (contoso.com)|13.77.161.179|:80... connected.

HTTP request sent, awaiting response... 301 Moved Permanently

Location: https://www.microsoft.com/ms.htm [following]

--2021-12-15 14:23:09--  https://www.microsoft.com/ms.htm

Resolving www.microsoft.com (www.microsoft.com)... 104.109.241.178, 2600:1410:4000:192::356e, 2600:1410:4000:193::356e, ...

Connecting to www.microsoft.com (www.microsoft.com)|104.109.241.178|:443... connected.

HTTP request sent, awaiting response... 301 Moved Permanently

Location: https://www.microsoft.com/ [following]

--2021-12-15 14:23:09--  https://www.microsoft.com/

Reusing existing connection to www.microsoft.com:443.

HTTP request sent, awaiting response... 302 Moved Temporarily

Location: https://www.microsoft.com/ko-kr/ [following]

--2021-12-15 14:23:09--  https://www.microsoft.com/ko-kr/

Reusing existing connection to www.microsoft.com:443.

HTTP request sent, awaiting response... 200 OK

Length: unspecified [text/html]

Saving to: ‘index.html’

 

index.html                 [ <=>                       ] 184.00K  1.14MB/s    in 0.2s

 

2021-12-15 14:23:10 (1.14 MB/s) - ‘index.html’ saved [188420]

■  다운로드 가능한지 확인하기

 

$ wget --spider [다운로드URL]

$ wget --spider https://www.google.com/

 

• 다운로드가 가능할 경우

Spider mode enabled. Check if remote file exists.

--2021-12-15 11:38:54--  https://www.google.com/

Resolving www.google.com (www.google.com)... 172.217.174.100, 2404:6800:4004:808::2004

Connecting to www.google.com (www.google.com)|172.217.174.100|:443... connected.

HTTP request sent, awaiting response... 200 OK

Length: unspecified [text/html]

Remote file exists and could contain further links,

but recursion is disabled -- not retrieving.

 

• 에러인 경우

Spider mode enabled. Check if remote file exists.

--2021-12-15 11:42:48--  https://www.google.comp/

Resolving www.google.comp (www.google.comp)... failed: Name or service not known.

wget: unable to resolve host address ‘www.google.comp’

  또는

Spider mode enabled. Check if remote file exists. 

HTTP request sent, awaiting response... 404 Not Found 

Remote file does not exist -- broken link!!!

같은 오류 정보가 출력된다

■  재시도 횟수 지정하기

$ wget --tries=[횟수] [다운로드URL]

$ wget --tries=777 https://www.google.com/

인터넷 문제가 있거나 파일 다운로드에 실패할 경우

--tries옵션이 없으면 기본 재시도 횟수는 20회이다

■  여러 개의 파일 다운로드 하기

$ wget -i [다운로드URL/파일명]

-i 옵션이 있으면 [다운로드URL/파일명] 에 해당하는 파일안에 기입되어있는 주소들을 다운로드 한다. 각각의 다운로드할 주소들의 구분은 한줄(엔터)로 구분된다.

예를 들어 list.txt 파일 안에 내용이

https://www.google.com/

https://www.youtube.com/

라고 써있으면 2개의 다운로드를 진행 함

■  ftp 다운로드하기

wget ftp://ftpmirror.your.org/pub/misc/ftp.microsoft.com/developr/TAPI/README.TXT