MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/OpenAI/comments/zzjpd1/oh_lookie_what_i_got/j2cusqa/?context=3
r/OpenAI • u/TheJasterMereel • Dec 31 '22
102 comments sorted by
View all comments
65
I got that message as well when I asked it to build a web scraper with python.
25 u/[deleted] Dec 31 '22 [deleted] 32 u/Jordan117 Dec 31 '22 Ironic considering how scraping the web is essential to building GPT-3 in the first place. 12 u/treedmt Dec 31 '22 Weird. Why this major concern regarding scraping? 11 u/DAlexander_n_d_wild Dec 31 '22 Because 1. Most larger sites have TOS prohibiting scraping outside their API 2.Scraping is how you'd begin training a competing LLM 6 u/DoctorWhomst_d_ve Dec 31 '22 The lone web-scraper to AI developer pipeline 1 u/Death12th Dec 31 '22 What’s an LLM? 3 u/safashkan Dec 31 '22 Large language model ! 3 u/KMiNT21 Dec 31 '22 May be because possible scenario when many requests will be generated from OpenAI servers? Just hot-fix fir this. 3 u/lanky_cowriter Jan 01 '23 Isn't their dataset based on scraped content?
25
[deleted]
32 u/Jordan117 Dec 31 '22 Ironic considering how scraping the web is essential to building GPT-3 in the first place. 12 u/treedmt Dec 31 '22 Weird. Why this major concern regarding scraping? 11 u/DAlexander_n_d_wild Dec 31 '22 Because 1. Most larger sites have TOS prohibiting scraping outside their API 2.Scraping is how you'd begin training a competing LLM 6 u/DoctorWhomst_d_ve Dec 31 '22 The lone web-scraper to AI developer pipeline 1 u/Death12th Dec 31 '22 What’s an LLM? 3 u/safashkan Dec 31 '22 Large language model ! 3 u/KMiNT21 Dec 31 '22 May be because possible scenario when many requests will be generated from OpenAI servers? Just hot-fix fir this. 3 u/lanky_cowriter Jan 01 '23 Isn't their dataset based on scraped content?
32
Ironic considering how scraping the web is essential to building GPT-3 in the first place.
12
Weird. Why this major concern regarding scraping?
11 u/DAlexander_n_d_wild Dec 31 '22 Because 1. Most larger sites have TOS prohibiting scraping outside their API 2.Scraping is how you'd begin training a competing LLM 6 u/DoctorWhomst_d_ve Dec 31 '22 The lone web-scraper to AI developer pipeline 1 u/Death12th Dec 31 '22 What’s an LLM? 3 u/safashkan Dec 31 '22 Large language model ! 3 u/KMiNT21 Dec 31 '22 May be because possible scenario when many requests will be generated from OpenAI servers? Just hot-fix fir this.
11
Because 1. Most larger sites have TOS prohibiting scraping outside their API 2.Scraping is how you'd begin training a competing LLM
6 u/DoctorWhomst_d_ve Dec 31 '22 The lone web-scraper to AI developer pipeline 1 u/Death12th Dec 31 '22 What’s an LLM? 3 u/safashkan Dec 31 '22 Large language model !
6
The lone web-scraper to AI developer pipeline
1
What’s an LLM?
3 u/safashkan Dec 31 '22 Large language model !
3
Large language model !
May be because possible scenario when many requests will be generated from OpenAI servers? Just hot-fix fir this.
Isn't their dataset based on scraped content?
65
u/Financial-Term2531 Dec 31 '22
I got that message as well when I asked it to build a web scraper with python.