BeautifulSoup find_all IndexError: Empty Match Fix (2026)

You ran elements = soup.find_all("div", class_="price") and then elements[0].text, but the page returned no matching divs, so the list was empty and you got IndexError. Web scraping is full of this trap because HTML structure changes without warning.

📌 Quick answer: Use soup.find(...) instead of soup.find_all(...)[0], find returns None on no match (instead of raising). Or use soup.select_one(...) for CSS-selector style. For multiple matches, iterate with for el in soup.find_all(...): which handles empty gracefully.

Pattern 1: Use find() for single elements

find() returns the first matching tag, or None if no match.

from bs4 import BeautifulSoup
soup = BeautifulSoup(html, "html.parser")

# ❌ Crashes if no .price element
price = soup.find_all("div", class_="price")[0].text

# ✓ find() returns None on no match
price_el = soup.find("div", class_="price")
price = price_el.text if price_el else None

Pattern 2: select_one for CSS selectors

Closer to JavaScript document.querySelector(). Same None-on-miss behavior as find().

price_el = soup.select_one("div.price")
if price_el:
    price = price_el.get_text(strip=True)
else:
    price = None

Pattern 3: iterate find_all (always safe)

The for loop over an empty list is a no-op, no IndexError possible.

for product in soup.find_all("div", class_="product"):
    name = product.find("h2")
    price = product.find("span", class_="price")
    if name and price:
        print(name.text, price.text)

Pattern 4: defensive helper for attribute access

Chained .find().attribute[“foo”] is fragile. Wrap with try/except or use .get() on attributes.

img = soup.find("img")
src = img.get("src") if img else None    # img.get("src") returns None on missing attr too

Prevention

1. Default to find()/select_one() for single elements
2. Iterate find_all() with for loop instead of indexing
3. Always check element is not None before .text or attribute access
4. Use .get(“attr”) on tags instead of tag[“attr”] (returns None on missing attr)

Related Guides

• List index out of range (full guide)
• String index out of range
• All IndexError fixes
• Python Tutorial hub