UKBouldering.com

Extracting links from a site (Read 2751 times)

Monolith

Offline
  • *****
  • forum hero
  • Straight outta Cronton.
  • Posts: 3955
  • Karma: +218/-6
Extracting links from a site
November 02, 2008, 09:31:35 pm
OK, I have absolutely no idea where to start on this sort of thing.

In my mind, I need an application (if a mac version exists great, if not, still would love to hear of it) that can rinse all links within a site that begin with http://rapidshare.

I'd then like some sort of download scheduler where I can copy and paste them in and leave my computer running until all files have been downloaded.

Would anyone have an idea of what applications/methods I could use to do this?

Thanks in advance homeboys and girls.

Jim

Offline
  • *****
  • Trusted Users
  • forum hero
  • Mostly Injured
  • Posts: 8629
  • Karma: +234/-18
  • Pregnant Horse
    • Bouldering POI's for tomtom
#1 Re: Extracting links from a site
November 03, 2008, 05:48:39 am
There are plenty of download managers out there. I've never used one so can't recomend any I'm afraid especially not for mac

Monolith

Offline
  • *****
  • forum hero
  • Straight outta Cronton.
  • Posts: 3955
  • Karma: +218/-6
#2 Re: Extracting links from a site
November 03, 2008, 10:16:43 am
Thought that would be the case but it's mostly the first part I'm lost with.

lagerstarfish

Offline
  • *****
  • forum hero
  • Weapon Of Mass
  • Posts: 8825
  • Karma: +820/-10
  • "There's no cure for being a c#nt"
#3 Re: Extracting links from a site
November 03, 2008, 12:00:59 pm
I use GetRight. It's great. Not sure if it works for Mac.
Plenty of torrents out there.

I copy and paste the URLs into Notepad, save them as a .urls file and then GetRight can import the download list and get on with downloading (and retrying if it needs to). I tend to tell it to only download 12 files at once coz more than that tends to be slow enough for sessions to get timed out by the host.

 

SA Chris

Offline
  • *****
  • forum hero
  • Posts: 29384
  • Karma: +638/-12
    • http://groups.msn.com/ChrisClix
#4 Re: Extracting links from a site
November 03, 2008, 12:17:50 pm
Have you recovered lagers? Congratulations btw.

lagerstarfish

Offline
  • *****
  • forum hero
  • Weapon Of Mass
  • Posts: 8825
  • Karma: +820/-10
  • "There's no cure for being a c#nt"
#5 Re: Extracting links from a site
November 03, 2008, 12:23:06 pm
Have you recovered lagers? Congratulations btw.

Cheers. Yes I'm recovered and feeling very good  ;D

Re: GetRight - its free to use for a while as a legit download

Bubba

Offline
  • *****
  • Global Moderator
  • forum hero
  • Posts: 15367
  • Karma: +286/-6
#6 Re: Extracting links from a site
November 03, 2008, 12:56:21 pm
If you use Firefox then DownThemAll is superb for this sort of thing. It will scan all links on the page and you could just put "rapidshare*" in the filter box to get just the ones you want.

However, if you're after rapidshare links then I can't see how you're going to do it. When you click a rapidshare link you need to wait for the countdown to finish, then click the download button. I don't know of any download managers that could mimic that behaviour.
« Last Edit: November 03, 2008, 01:10:26 pm by Bubba »

lagerstarfish

Offline
  • *****
  • forum hero
  • Weapon Of Mass
  • Posts: 8825
  • Karma: +820/-10
  • "There's no cure for being a c#nt"
#7 Re: Extracting links from a site
November 03, 2008, 01:05:22 pm
If you have a rapidshare premium account you can set it to automatically download files without need for clicking on anything - this works fine with GetRight. As soon as the page is found, the download starts.

Monolith

Offline
  • *****
  • forum hero
  • Straight outta Cronton.
  • Posts: 3955
  • Karma: +218/-6
#8 Re: Extracting links from a site
November 03, 2008, 01:07:02 pm
Thanks for that guys.

Bubba- I have use of a rapidshare account which eliminates the need to wait for a download to commence. It also allows parallel downloads fortunately. I'll have a proper look at your suggestions when I get home so thanks for the suggestions in the meantime!

slackline

Offline
  • *****
  • forum hero
  • Posts: 18863
  • Karma: +633/-26
    • Sheffield Boulder
#9 Re: Extracting links from a site
November 05, 2008, 11:30:36 am
If you're on a Mac then you can also use the very handy and highly featured command 'wget' which will probably exist on your system (as Mac OSX is based on BSD yet another UNIX-like OS).

Fire up a terminal and type 'man wget' to see the help page for it.


Monolith

Offline
  • *****
  • forum hero
  • Straight outta Cronton.
  • Posts: 3955
  • Karma: +218/-6
#10 Re: Extracting links from a site
November 12, 2008, 12:40:39 pm
Slack, I've only just seen your response so thanks for that! Booting up terminal now....

 

SimplePortal 2.3.7 © 2008-2024, SimplePortal