Download data from a homepage?
Hello, a question for the programmers,
Let's say I want to compare supermarket prices in a specific segment. Is it technically possible to download the displayed products and prices using a self-written program? And what skills would be required to do this?
Yeah. Ideally, prices are made available via a standardized interface and can thus be evaluated reliably and quickly.
In the not so ideal (but here is much more likely) case Web-craping necessary. This can be quite laborious and require some manual work until it works. Some webshops also try to actively prevent it. But I can.
Yeah, that should be possible.
How exactly this depends on the respective seven. You should usually need knowledge in JavaScript and HTML, but, depending on the page, you may also need other (for example when sending requests to the knowledge about the request format).