github.com-harismuneer-Ultimate-Facebook-Scraper_-_2019-11-26_05-28-39

github.com-harismuneer-Ultimate-Facebook-Scraper_-_2019-11-26_05-28-39

Posted by

Download
ITEM TILE – File Size: 7.0K

🤖 A bot which scrapes almost everything about a Facebook user’s profile including all public posts/statuses available on the user’s timeline, uploaded photos, tagged photos, videos, friends list and their profile photos (including Followers, Following, Work Friends, College Friends etc).

Ultimate Facebook Scraper (UFS)

Tooling that automates your social media interactions to collect posts, photos, videos, friends, followers and much more on Facebook.

7f41790c3c3a4fd29293777c676c8617 Build-Passing-brightgreen.svg?style=flat open-source.svg?v=103 Ultimate-Facebook-Scraper.svg?style=soci contributions-welcome-brightgreen.svg?st


Contributors

Developers from following organizations have so far joined the quest and contributed to UFS.

Microsoft MIT Harvard NUCES
UCLA ACM LUMS


Features

A bot which scrapes almost everything about a user’s Facebook profile including:

  • uploaded photos
  • tagged photos
  • videos
  • friends list and their profile photos (including Followers, Following, Work Friends, College Friends etc)
  • and all public posts/statuses available on the user’s timeline.

Data is scraped in an organized format to be used for educational/research purposes by researchers. This scraper does not use Facebook’s Graph API meaning there are no rate limiting issues.

This tool is being used by thousands of developers weekly and we are pretty amazed at this response! Thank you guys!🎉

For citing/referencing this tool for your research, check the ‘Citation’ section below.

Note

This tool uses xpaths of ‘divs’ to extract data. Since Facebook updates its site frequently, the ‘divs’ get changed. Consequently, we have to update the divs accordingly to correctly scrape data.

The developers of this tool have devoted time and effort in developing, and maintaining this tool for a long time. In order to keep this amazing tool alive, we need support from you geeks.

The code is intuitive and easy to understand, so you can update the relevant xpaths in the code if you find data is not being scraped from profiles. Facebook has most likely updated their site, so please generate a pull request. Much appreciated!

Sample

main.png

Screenshot

screenshot.png


Usage

Installation

You will need to install latest version of Google Chrome. Moreover, you need to install selenium module as well using

pip install selenium

Run the code using Python 3. Also, the code is multi-platform and is tested on both Windows and Linux.The tool uses latest version of Chrome Web Driver. I have placed the webdriver along with the code but if that version doesn’t work then replace the chrome web driver with the latest one.

How to Run

There’s a file named “input.txt”. You can add as many profiles as you want in the following format with each link on a new line:

https://www.facebook.com/andrew.ng.96https://www.facebook.com/zuck

Make sure the link only contains the username or id number at the end and not any other stuff. Make sure its in the format mentioned above.

Note: There are two modes to download Friends Profile Pics and the user’s Photos: Large Size and Small Size. You can change the following variables. By default they are set to Small Sized Pics because its really quick while Large Size Mode takes time depending on the number of pictures to download

“`

whether to download the full image or its thumbnail (small size)

if small size is True then it will be very quick else if its False then it will open each photo to download it

and it will take much more time

friendssmallsize = Truephotossmallsize = True

“`

Citation

145763277.svg

If you use this tool for your research, then kindly cite it. Click the above badge for more information regarding the complete citation for this tool and diffferent citation formats like IEEE, APA etc.


Important Message

This tool is for research purposes only. Hence, the developers of this tool won’t be responsible for any misuse of data collected using this tool. Used by many researchers and open source intelligence (OSINT) analysts.


Authors

You can get in touch with us on our LinkedIn Profiles:

Haris Muneer

LinkedIn Link

You can also follow my GitHub Profile to stay updated about my latest projects: GitHub Follow

Hassaan Elahi

LinkedIn Link

You can also follow my GitHub Profile to stay updated about my latest projects:GitHub Follow

If you liked the repo then kindly support it by giving it a star ⭐!

Contributions Welcome

forthebadge

If you find any bug in the code or have any improvements in mind then feel free to generate a pull request.

Issues

GitHub Issues

If you face any issue, you can create a new issue in the Issues Tab and I will be glad to help you out.

License

MIT

Copyright (c) 2018-present, harismuneer, Hassaan-Elahi

To restore the repository download the bundle

wget https://archive.org/download/github.com-harismuneer-Ultimate-Facebook-Scraper_-_2019-11-26_05-28-39/harismuneer-Ultimate-Facebook-Scraper_-_2019-11-26_05-28-39.bundle

and run:

 git clone harismuneer-Ultimate-Facebook-Scraper_-_2019-11-26_05-28-39.bundle 

Source: https://github.com/harismuneer/Ultimate-Facebook-Scraper
Uploader: harismuneer
Upload date: 2019-11-26