A new report into competition in the UK and US ecommerce sectors has stressed that without real-time information ecommerce businesses may fail to reach their full growth potential this year.
In conjunction with Censuswide, Oxylabs surveyed 500 UK-based and 501 US-based senior data decision-makers from ecommerce companies, gathering insights on attitudes towards public web data collection in the sector.
The report found 62% of ecommerce firms think that real-time data will be at the forefront in 2023.
As most web pages today are subject to frequent content changes, real-time web scraping is an essential function for any digital business. Real-time web scraping will also be increasingly important to ecommerce businesses in the future, allowing them to track information on their competitors’ websites and other online stores.
As companies begin to rely more on efficient and low-cost data collection methods such as external data gathering, used by 40.54% of respondents, there is a clear shift towards gaining more actionable insights.
Tomas Montvilas, chief commercial officer at Oxylabs, said: “These goals might indicate that businesses have yet to harness the true potential of real-time data. Greater data delivery speeds and instant insights can prove itself to be the next edge of competition that ecommerce companies are faced with.
“As competitors adopt real-time data for purposes such as monitoring, others will want to follow suit, causing a feedback loop. I expect to see real-time data keep climbing in importance in the coming years.”
The report said these trends show that ecommerce companies must consider new challenges in their business environment. For applications with low analytical requirements, such as dynamic pricing, real-time data is most valuable. Meanwhile the most widely used use case for external data was cited as market research—which necessitates high levels of involvement with the data.
According to the report, US-based companies will focus more on collecting and utilising external data (43.91% vs 37.20%), whereas their non-US counterparts will pay closer attention to managing existing infrastructure—56.09% vs 44.49%.
On the other hand, UK-based companies are planning to focus more on real-time acquisition (65.94% vs 58.28%) and data quality assurance (28.35% vs 18.96%). This contrast shows that the two regions have unique web scraping environments, as each one faces specific issues in this regard.
Montvilas concluded: “As ecommerce has grown exponentially, businesses are increasingly dependent on data. Today’s organisations feel compelled to measure everything from the number of transactions per hour to the lifetime value of their customers.
“Web scraping has become an essential part of all decision-making processes for businesses large and small, which means that ecommerce companies can now use real time data to gain a competitive edge in difficult economic times”.