Large-scale web scraping for problem gambling research: a case study of COVID-19 lockdown effects in Germany

AbstractThe COVID-19 pandemic and the measures to prevent its spread have had a negative impact on substance use behaviour and posed a special threat for individuals at risk. Problem gambling is a major public health concern, and it is likely that the lockdown and social distancing measures have altered gambling behaviour, for instance shifting from land-based to online gambling. In this study, we used large-scale web scraping to analyse posting behaviour on a major German online gambling forum, gathering a database of more than 200k posts. We examined the relative usage of different subforums, i.e. terrestrial, online gambling and problem gambling sections, posting frequency, and changes in posting behaviour related to the casino closures that were part of the nationwide restrictions in Germany in 2020. There was a marked increase in the number of newly registered users during the first lockdown compared to the weeks prior to the lockdown, which may reflect a shift from terrestrial to online gambling. Further, there was an increase in the number of posts in the online gambling subforum with a concurrent decrease in the number of posts in the terrestrial gambling subforum. An analysis of user types revealed that a substantial number of users who posted in both the online and terrestrial forum contributed at least once to the problem gambling subforum. This subforum contained the longest posts, which were on average twice as long as the average post. Modelling the relationship between reply frequency and latency between initial posts and replies showed that the number of short-latency replies (i.e. replies posted within seven hours after the initial post) was substantially higher during the first lockdown compared to the preceding weeks. The increase during the first lockdown may reflect the general marked increase in screen time and/or usage of online platforms and media after the onset of the global COVID-19 pandemic. The analyses may help to identify lockdown-related effects on gambling behaviour. These potentially detrimental effects on mental health, including addiction and problem gambling, may require monitoring and special public health measures.