Advanced Python: Web Scraping

Goal

• Extract data from websites

Step 1: Using BeautifulSoup

import requests
from bs4 import BeautifulSoup

url = "https://example.com"
page = requests.get(url)

soup = BeautifulSoup(page.text, "html.parser")

print(soup.title.text)

Explanation:

• requests.get(url) → fetches the HTML page
• BeautifulSoup(page.text, "html.parser") → makes HTML searchable
• soup.title.text → prints the title of the page

Task

• Read the title of a website
• Extract text or links