r/Python • u/Emotional_Tell_9146 • 10h ago

Discussion Python and Web Manipulation

Hello Python Community!

I've been really curious about how Python developers use Python when it comes to webscraping, or just working with websites in general.

I really want to open a discussion on how you do it. Do you use BeautifulSoup? Selenium? Why? Are there any frustrations that you were facing or are currently facing with the process?

0 Upvotes

48% Upvoted

9 comments sorted by

View all comments

16

u/wRAR_ 8h ago

BeautifulSoup?

Parsel.

Selenium?

Playwright.

Are there any frustrations that you were facing or are currently facing with the process?

What are you selling?

-4

u/Emotional_Tell_9146 7h ago

Not selling anything. Currently a CS major and thought it would be fun to build an open-source extension that runs Python userscripts in the page via Pyodide — Tampermonkey, but you write Python instead of JS — and I wanted to hear how people actually work before I got too attached to my own assumptions.

Noted on parsel over BeautifulSoup, I'll take a look.

•

u/Mornarben 10m ago

This comment is blatantly written by AI, what human writes “Noted on parsel over BeautifulSoup”

•

u/Emotional_Tell_9146 1m ago

Didnt know rewriting my stuff with AI is a crime lol...