Download data from a homepage?

Hello, a question for the programmers,

Let's say I want to compare supermarket prices in a specific segment. Is it technically possible to download the displayed products and prices using a self-written program? And what skills would be required to do this?

(2 votes)
Loading...

Similar Posts

Subscribe
Notify of
2 Answers
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
jo135
1 year ago

it is then technically possible to download the visible products and prices via self-written program

Yeah. Ideally, prices are made available via a standardized interface and can thus be evaluated reliably and quickly.

In the not so ideal (but here is much more likely) case Web-craping necessary. This can be quite laborious and require some manual work until it works. Some webshops also try to actively prevent it. But I can.

Destranix
1 year ago

Yeah, that should be possible.

How exactly this depends on the respective seven. You should usually need knowledge in JavaScript and HTML, but, depending on the page, you may also need other (for example when sending requests to the knowledge about the request format).