How to mirror 3rd Party Content server on own site ??

They have: 3 posts

Joined: Jan 2001

Probably seems a weird question but I'm interested in mirroring
selected parts of 3rd party sites on my own web site.
Can you do this ?
Is it a nightmare etc ? Any thoughts tips approaches appreciated.
(I'm not a hardcore tech so keep it fairly simple please !!)

I would want:

a) A highly customisable software tool that allows me to select which sites to mirror at any one time (list of sites is always changing, a typical list might be 100 URLs)

b) Allows partial site mirroring. In general I would want to mirror just a section of a site, often a specific URL and just the text content of the site to the depth of 1 or 2 URL links.

c) If there was an integrated search tool built into the software great (was thinking of using Atomz.com otherwise).

d) I mentioned I was a non-tech, are there companies out there that would offer this aa a turnkey package ? (ASP type model I guess). OR Techs that are interested in putting this package together ?

If your puzzled and want more details just shout happy to explain more.

Thankx

Tim
Parallel_Research
Manchester, UK

Mark Hensler's picture

He has: 4,048 posts

Joined: Aug 2000

mirroring content?
do these '3rd party' sites know about this?

They have: 3 posts

Joined: Jan 2001

NO they don't.
ie no file access to their servers.

(I'm not stealing mp3's or redistributing mirror content,
its for competitor monitoring)

Tim
Parallel54

Justin S's picture

They have: 2,076 posts

Joined: Jun 1999

Do you mean something like what http://www.mysimon.com does? It takes prices from different places and displays them on one page? I don't really get when you say "mirroring," since that word is usually used when you put your content on another server, so if one is down they can access the other one. Please explain.

They have: 3 posts

Joined: Jan 2001

Your right "mirroring" was a confusing term to use.
What I mean is that I want to track content on other sites
(of my choosing) using a server based application.

I would want to keyword search the selected sites and
be notified when new content matching my criteria was met.
This would not be for public display. It would only be for
our own internal use. Additionally it would not be
neccessary to actually host the "found" or matching content
merely to link to it.
(my thinking on this part has moved on a bit since the original post: I've had responses from a few other people).

The easiest analogy is to visit:

http://www.moreover.com

Now imagine your own personal set of links to content
where you specified the sites and the keywords (and
were able to update them over time).

1) Can this be done ?
2) Where can I find more info on a solution? Surely someone somewhere has coded something similar (or is it just a case of hiring a programmer and building from scratch.)

Thanks in advance,
Tim

[email protected]

Mark Hensler's picture

He has: 4,048 posts

Joined: Aug 2000

ahhh, yes... moreover.
I have not seen any script that does that. (doens't mean it doesn't exist)

Want to join the discussion? Create an account or log in if you already have one. Joining is fast, free and painless! We’ll even whisk you back here when you’ve finished.