About project
Fetch Latest news headlines and get them on your email inbox using Python
Have you heard of Google News, which collects the news headlines from the various trusted sources? Google uses a Machine Learning algorithm to capture various instances from a pool of resources. Before I start, let me make you clear that the project that is being discussed here is not a Machine Learning technique.
In this web scraping with Python code, the data (basically the news headlines) are collected from Google news, displayed on the console window as well as a copy of the same will be sent to your e-mail at the same time. On every execution, this Python code scrapes the news headlines and do some custom formatting before saving it to notepad (or text file). In the consequent stage, the e-mail is composed by accessing the text file and finally sent to the mentioned e-mail address. Look at the video to get complete information.
YouTube Video
Python code
from selenium import webdriver
from selenium.webdriver.common.keys import Keys
import datetime, time, os
import smtplib
from email.message import EmailMessage
td = datetime.date.today()
# create a webdriver object for chrome-option and configure
wait_imp = 10
CO = webdriver.ChromeOptions()
CO.add_experimental_option('useAutomationExtension', False)
CO.add_argument('--ignore-certificate-errors')
CO.add_argument('--start-maximized')
wd = webdriver.Chrome(r'D:\Learning\Practice\Selenium\chromedriver.exe',options=CO)
print ("Connecting to Authentic News source, Please wait .....\n")
news_site = "https://news.google.com/topstories?hl=en-IN&gl=IN&ceid=IN:en"
print (" ------------------------------------------------------------------------------------------- ")
print (">>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> TODAY's TOP NEWS HEADLINES <<<<<<<<<<<<<<<<<<<<<<<<<<<<< ")
print ("Date:",td.strftime("%b-%d-%Y"))
print (" -------------------------- ")
wd.get(news_site)
wd.implicitly_wait(wait_imp)
elems = wd.find_elements_by_tag_name('h3')
file_loc = r'D:\Learning\Practice\Selenium\Latest News\newsfile.txt'
file_to_write = open(file_loc, 'w+')
ind = 1
for elem in elems:
file_to_write.write(str(ind)+ '>> ')
file_to_write.write(elem.text+'\n')
print (str(ind) + ") " + elem.text)
ind += 1
file_to_write.close()
print('\n')
# Get credentials from the system
USER_EMAIL = os.environ['user_email']
MY_PASS = os.environ['my_pass']
MY_EMAIL = os.environ['my_email']
# Compose message
msg = EmailMessage()
msg['From'] = MY_EMAIL
msg['To'] = USER_EMAIL
msg['Subject'] = " Hello ! Today's TOP news HEADLINES >>"
with open(file_loc,'rb') as f:
N_file = f.read()
# Body of email
msg.set_content("Find the attached document for detailed NEWS .. ")
msg.add_attachment(N_file, maintype = 'document',subtype = 'txt', filename = f.name )
# Configure server
server = smtplib.SMTP('smtp.gmail.com', 587) #tls , ssl
server.ehlo()
server.starttls()
server.ehlo()
server.login(MY_EMAIL,MY_PASS)
server.send_message(msg)
print ("A copy of this NEWS HEADLINES has been sent to your E-mail Successfully !!")
print ("Have a Nice Day !!")
server.quit()
