dimanche 8 mars 2015

how to do CLI data gathering from secure nonprofit website


I am a member of a highly public online forum with approximately 65,000 members (and no, the forum is not a member of the Stack Exchange family). I want to do statistical analysis on the freely viewable public profiles of the members but also want to remain independent from the forum's owners and operators, who have not retained me and take no position on my activities. The profile pages are pHp files. I thought of using wget to download them and writing a bash script to make the process automatic, but, while all forum posts are publicly viewable without login, viewing the profile pages requires login and a CLI login does not seem to be available. What can I do other than ask the webmaster if they'd be willing to provide me with a copy of the member profile database?



Aucun commentaire:

Enregistrer un commentaire