# Internet reaptability???

**URL:** https://boards.straightdope.com/t/internet-reaptability/609110
**Category:** Factual Questions
**Created:** [January 11, 2012, 12:41am UTC](https://boards.straightdope.com/t/internet-reaptability/609110 "2012-01-11T00:41:35Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![ornan](https://avatars.discourse-cdn.com/v4/letter/o/6f9a4e/32.png) [@ornan](https://boards.straightdope.com/u/ornan)
#### Post date: [January 11, 2012, 12:41am UTC](https://boards.straightdope.com/t/internet-reaptability/609110/1 "2012-01-11T00:41:35Z")

</div>

How can I write a program that will extract data from web site#1 and input it into website#2 and website#3 then take the data from website#3 back to website #2? this is somthing that has to be done 100 to 150 times. Its getting old and its a lot of work  
Need help:confused:

---

<div class="post-metadata">

### Author: ![friedo](https://avatars.discourse-cdn.com/v4/letter/f/8edcca/32.png) [@friedo](https://boards.straightdope.com/u/friedo)
#### Post date: [January 11, 2012, 12:57am UTC](https://boards.straightdope.com/t/internet-reaptability/609110/2 "2012-01-11T00:57:49Z")

</div>

[Here ya go](https://metacpan.org/module/WWW::Mechanize). Happy coding.

---

<div class="post-metadata">

### Author: ![Shagnasty](https://avatars.discourse-cdn.com/v4/letter/s/9dc877/32.png) [@Shagnasty](https://boards.straightdope.com/u/Shagnasty)
#### Post date: [January 11, 2012, 1:35am UTC](https://boards.straightdope.com/t/internet-reaptability/609110/3 "2012-01-11T01:35:16Z")

</div>

Nobody ever said customs programming was easy. That is why we get paid the big bucks. Pick up a book and compiler in Python. Spend a year learning it and then do whatever you need to like this.

The description of your problem is so hopelessly vague that nothing other than general advise like that is possible. There may be shortcuts for one-off problem there is no way for us to know that. You could also hire a consultant for a few hundred or a few thousand dollars to do it for you but again, vague problems get vague answers.

---

<div class="post-metadata">

### Author: ![Reply](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/reply/32/15952_2.png) [@Reply](https://boards.straightdope.com/u/Reply)
#### Post date: [January 11, 2012, 1:44am UTC](https://boards.straightdope.com/t/internet-reaptability/609110/4 "2012-01-11T01:44:12Z")

</div>

1. Look into “screen scraping”. That’d at least get you started.

2. Depending on the complexity of the sites in question, you might try [Yahoo Pipes](http://pipes.yahoo.com/pipes/) rather than actual coding. Much less powerful but much easier.

3. If the data is repetitive and not changing, you might even get away with a macro program like Autohotkey or iMacros for your browser.

---

<div class="post-metadata">

### Author: ![iamthewalrus\_3](https://avatars.discourse-cdn.com/v4/letter/i/258eb7/32.png) [@iamthewalrus\_3](https://boards.straightdope.com/u/iamthewalrus_3)
#### Post date: [January 11, 2012, 2:03am UTC](https://boards.straightdope.com/t/internet-reaptability/609110/5 "2012-01-11T02:03:34Z")

</div>

> [@ornan](#):
>
> How can I write a program that will extract data from web site#1 and input it into website#2 and website#3 then take the data from website#3 back to website #2?

I’m not sure what you’re asking, here. If you’re getting the data from site1 originally and sending it to site2 and site3, why do you then need to get it again from site3 and send it back to site2?

But, yeah, you’re likely to need to use an actual programming language if this is very complicated. Python is pretty awesome for screen scraping, but you need to understand how to program in it and also some of how web pages are structured in order to get very far.

---

<div class="post-metadata">

### Author: ![Blakeyrat](https://avatars.discourse-cdn.com/v4/letter/b/ecd19e/32.png) [@Blakeyrat](https://boards.straightdope.com/u/Blakeyrat)
#### Post date: [January 11, 2012, 9:18pm UTC](https://boards.straightdope.com/t/internet-reaptability/609110/6 "2012-01-11T21:18:43Z")

</div>

> [@ornan](#):
>
> How can I write a program that will extract data from web site#1 and input it into website#2 and website#3 then take the data from website#3 back to website #2? this is somthing that has to be done 100 to 150 times. Its getting old and its a lot of work  
> Need help:confused:

[ifttt.com](http://ifttt.com/wtf) supports Twitter, Facebook, Instagram, Email, Dropbox, Craigslist, RSS, Flickr, WordPress, etc.

Depending on what sites you’re talking about, that might do the job for you. It’s a heck of a lot easier than learning Python.
