Hi there
I've worked on several data mining and scraping projects, technical and academical, i've worked on data mining and text mining algorithms (NLP), scraping data from twitter and other webistes and even discord, telegram and so on, i wrote some papers regarding to this approach, i've worked with hadoop, map reduce technology as well, actually this is my job, programming+datamining+text mining+distributed systems, databases (sql server, no sql), i do it in a right way because beside my technical knowledge this is what i've studied over years.