updating database-CSV or SQL?

[hiedler]

hi
i already have script,which is scraping one site with products and put them all in one CSV file,ready for upload. This can work fine if i want to just fill up the database with products.
the problem is,that i need to watch the sizes and price of all products every day,according to actual informations on that site which i scrap.
question is- what is better/easier/possible?
find just the products with change (once a day lets say…) and change/update them in database with SQL query
OR
change/update them somehow with CSV file?
thanks for answer

[ecentury]

Sorry for the late reply

But a SQL query has to be the way to go on this, a csv upload could not cope

We have done this with many clients, let us know if you have any questions

Thanks

DAvid

[Nikolai]

hi

i already have script,which is scraping one site with products and put them all in one CSV file,ready for upload. This can work fine if i want to just fill up the database with products.

the problem is,that i need to watch the sizes and price of all products every day,according to actual informations on that site which i scrap.

question is- what is better/easier/possible?

find just the products with change (once a day lets say…) and change/update them in database with SQL query

OR

change/update them somehow with CSV file?

thanks for answer

 

If you need to view result os scraping before data export to CSV you have to use sollution which supports it.

I know that V4 web scraper does it (allows user to to make preview after web scraping and before data export)

Find more here : http://mydataprovider.com/