Package: scrapeShivam
Author: Shivam VishwakarmaScrapping1 Altnews.com scrapping
2 Google Image Scrapping
3 Instagram user profile scrapping based on username
4 Instagram single post scrapping based on link
5 Facebook post scrapping based on postlink
6 Twitter post scrapping based on link
7 Tradingview chart image scrapping
8 Whatsapp messaging using whatsappweb1 ALTNEWSThis is a Indian fact news checking site. this package is helpful to scrape all data and create a dataframe
of every article which is available on site .
data includes:
Text
Author name
Date
Title
Link2 Google Image DownloaderIn this module you can scrape all images based on given image name . Basically it takes a few minutes to scrape all imaes . it iterates
over all image sub categories and scrape them . This is very useful for making dataset of difficult images dataset .
Required only name of image3 Instagram user profile scrappingScrape a whole user profile images based on instagram userid just need userid .4 Scrapping instagram postsThis is helpful to scrape data related to a instagram post . shared link of post.5 Scrapping Facebook postThis is related to scrape post of the faceebook based on shared link of facebook post .6 Scrapping Twitter postJust get the shareable link of twitter post . Use that as a url to the function and it will return data related to posts .7 Scrapping trading view image chartThis is to save image of the tradingview chart based on symbol,timeinterval . THis is helpful to make dataset for trading projects .8 Whatsapp messagingHere we can send messages to existing friends in the user accout . This is based on whatsapp web . Just need to scan whatsapp QR code and start to message to the friends . You can send a messages n no. of times .
Ex:
target='varsha'
message='Hi'
n=10
Then it will send message Hi 10 times to varsha .Importing scrapperShivam***************************************************************fromscrapperimportscrape***************************************************************1 # Altnews.com***************************************************************#1 Scrapping full Fake News dataset from altnews.comscrape.altnews()***************************************************************2 # scrape fb_post***************************************************************# Scrapping facebook post based on fb_urlurl="""http://www.facebook.com/story.php?story_fbid=1465359780314951&id=100005228298088&scmts=scwspsdd&extid=zIROvP0jkc3UkapK"""text,image,url=scrape.fb_post(url)# Facebook shared link of post***************************************************************('मेरे द्वारा एक निजी इंजीनियरिंग कॉलेज के फेसबुक पेज पर खुद के वेतन और संस्था की सच्चाई पूर्ण विनम्रता के साथ कॉमेंट बॉक्स में लिखी थी तो कॉलेज प्रशासन ने उसे हटा दिया और सभी स्टाफ मेंबर से बोला है कि...',
 'https://scontent.fixc7-1.fna.fbcdn.net/v/t1.0-9/116582208_1465359653648297_6414823970251708469_o.jpg?_nc_cat=103&_nc_sid=110474&_nc_ohc=dAOYaJ52M2oAX-GH2UF&_nc_ht=scontent.fixc7-1.fna&oh=a5e88e7ad2018bb1764f2c97b2caa9f9&oe=5F9ACA07',
 'https://www.facebook.com/permalink.php?story_fbid=1465359780314951&id=100005228298088')3 # scrape image from google***************************************************************# scrapping all images from google based on image namescrape.google_image('./chromedriver','football')# param1 : chromedriver_path# param 2 : image name to download***************************************************************4 # Instagram scrape post***************************************************************# Instagram post scrapping based on linkinsta_post_url='https://www.instagram.com/p/CFy6m47lFJi/?utm_source=ig_web_button_share_sheet'text,image=scrape.insta_post(insta_post_url)# param 1 : instagram shared post url***************************************************************Trying with : https://www.instagram.com/p/CFy6m47lFJi/?utm_source=ig_web_button_share_sheet





('\nAmbivert परिंदा 🦋 (@curlicious_memer) posted on Instagram: “Paisa barbaad bc ..ab lagta Whitehat jr. p hi registration krna pdega 😕😂 Follow @curlicious_memer for more . . . . . . #softwareengineer…” • Oct 1, 2020 at 9:16am UTC\n',
 'https://instagram.fixc7-1.fna.fbcdn.net/v/t51.2885-15/e35/120477874_330305014963377_8160288912634310107_n.jpg?_nc_ht=instagram.fixc7-1.fna.fbcdn.net&_nc_cat=109&_nc_ohc=lesd4rVgfMAAX_z-3yo&_nc_tp=18&oh=5fcfd512ef4c3dbb88fbbe181f2bea3b&oe=5FA1AFA0')5 # Scrape Insta profile***************************************************************# scrapping all images of a insta user profilescrape.insta_profile('./chromedriver','shivamthevirus')# param 1 : Chromedriver_path# param 2 : instagram profile username***************************************************************Retrieving ..............
Started downloading .........6 # Scrape chart image from tradingview***************************************************************# scrapping chart image from tradingview.com based on symbol and time intervalscrape.trade('./chromedriver','reliance',t='month')#t=month/minute/hour/week/# param1 : chromedriver_path#param2 : stock symbol name# param3 : time_interval***************************************************************image_url :  https://www.tradingview.com/x/WVWuMkqj/





'images/reliance-2.png'7 # Scrapping Post from twitter link***************************************************************twit_url='https://twitter.com/rashtrapatibhvn/status/1311647175747592198?s=20'text.image,url=scrape.twit_post(twit_url)# param1 : shared link of facebook_post***************************************************************Trying with : https://mobile.twitter.com/rashtrapatibhvn/status/1311647175747592198?s=20





('  आज मेरे जन्मदिन पर मुझे अनेक शुभकामना सन्देश प्राप्त हुए हैं। इसके लिए मैं हृदय से आभार व्यक्त करता हूं। आप सभी देशवासियों के स्नेह और सौहार्द से मुझे राष्ट्र की सेवा में तत्पर रहने की प्रेरणा व ऊर्जा प्राप्त होती है। आप सभी का बहुत-बहुत धन्यवाद!\n',
 '',
 '')8 # messaging with web.whatsapp.com***************************************************************# scan web.whatsapp qrcode and give input y to continuescrape.whatsapp('./chromedriver')#param 1 : chromedriverpath***************************************************************