Scrapy @ScrapyProject
The most popular open source web scraping framework in Python. scrapy.org Joined January 2010-
Tweets446
-
Followers6K
-
Following7
-
Likes99
“scrapy” became my alter ego. it all started with my first ever python project, a simple web scraper that pulled headlines from top news sites. i used the scrapy library by @ScrapyProject. it wasn’t much, just a script. but it was the first thing i built that actually worked. and that made it special. later, i realized something funny: most of my ideas felt like fragments, messy, raw, not yet stitched together. so the word “scrapy” stuck. i even launched a few nft projects under the name “ScrapyNFTs”, none of them took off (my art was pretty scrapy too lol). nfts introduced me to web3, which led me to explore blockchain… and eventually evolve into @scrapychain.
10 years after the release of 1.0, Scrapy has become table stakes for modern web scraping projects. Creator Shane Evans talks through Scrapy's current position in the industry. #ScrapyAnniversary #OpenSource #WebScraping
Read the full editorial about the rise of Scrapy 👉 zyte.com/blog/the-rise-…
Before powering massive scraping operations globally, #Scrapy started as a workaround at a startup that needed structured data fast. @zytedata CEO and Scrapy creator Shane Evans takes a look at those early days of Scrapy 👇 #ScrapyAnniversary #WebScraping
Scrapy didn’t start in a lab. It started in a startup. From solving real-world data problems to becoming one of the most trusted scraping frameworks out there—here’s how it all began. 👉 zyte.com/blog/the-rise-… #ScrapyAnniversary #OpenSource #Python
Scrapy 2.8.0 is out. This is a maintenance release, with minor features, bug fixes, and cleanups. See the full changelog at docs.scrapy.org/en/latest/news…
@talenodigital Yes, you can download the results in CSV format as well. Available formats: docs.scrapy.org/en/latest/topi…
@talenodigital Try switching from CrawlerProcess to CrawlerRunner and see if that helps. For more details: doc.scrapy.org/en/latest/topi…
Have you got what it takes to be called a web scraping whizz? Join the @ExtractSummit 2022 Coding Contest to find out!
Join us for the Extract Summit 2022 Coding Contest and stand a chance to win bragging rights plus awesome prizes! Register for free - hubs.li/Q01mcYkL0 #coding #webdata #dataextraction #webscraping #scrapy #python
Dive into the world of web data! Register for Extract Summit.
6 weeks to go for Extract Summit 2022! Have you booked your seat yet? hubs.li/Q01kgnyy0
Scrapy 2.6.2 and 1.8.3 are out, addressing a security issue: docs.scrapy.org/en/2.6/news.ht… 2.6.2 also addresses the remaining regressions of 2.6.0.
Scrapy 2.6.1 is out, with security fixes around cookies also backported to Scrapy 1.8.2. But it is not just security fixes! There is official Python 3.10 support, asyncio support no longer being experimental, and new features for feed exports: docs.scrapy.org/en/latest/news…
Have you not tried Playwright and Scrapy together yet? Get started in 10 minutes! youtube.com/watch?v=0wO7K-… Thank you, @jhnwr!!!
@hatemjaber Thanks for reaching out to support. Please provide me with more information on which project that you are looking for?
We have released Scrapy 2.5.1 and Scrapy 1.8.1, which fix a security issue that could lead to the leak of HTTP authentication credentials to target websites. Find out more in the release notes: docs.scrapy.org/en/2.5/news.ht…
An introduction to Scrapy from @bsekiewicz , winner of the Extract Summit 2021 Coding Contest: worksmarter.pl/en/post/webscr…
Ready!
Extract Summit 2021 Live Coding Contest starts in 10 mins! Everyone ready?
Join Extract Summit for a day dedicated to web data extraction.
Today's the day! @ExtractSummit will start in 1 hour. We have 17 awesome talks lined up for you. Can't wait to hear from all the amazing speakers! hubs.li/H0YvRNb0 #ExtractSummit2021 #webdata #dataextraction #bigdata
There are prizes for the first 3 people with all data correctly scraped. The solutions must run on Scrapy Cloud. #scrapy #scraping #Python
Are you ready to show off your web scraping skills?💪🏼 Our devs created a coding contest EXCLUSIVELY for Extract Summit attendees. Sign up for Extract Summit and join us for the challenge. 👇🏼 hubs.li/H0Y3V8L0
Zyte @zytedata
4K Followers 300 Following The Web Scraping API built to reduce cost, increase accuracy and make devs faster.
Nikhil @nikhil_caas
0 Followers 11 Following
Eric Webb @agentic_webb
1 Followers 19 Following
Adrian Valverde @AdrianvValverde
27 Followers 398 Following Scrapeless Developer | Webscraping, automation & reverse engineer Discord Community: https://t.co/A80FzVVkKm
Carlos @DeaconFrost1118
441 Followers 6K Following NYS LICENSED PRIVATE INVESTIGATOR , NYS LICENSED SECURITY/FIRE ALARM INSTALLER, NYS PEST CONTROL LICENSE , NYS NOTARY
Bret Emm @EmmerichBret
74 Followers 812 Following WEB DEVELOPMENT javascript python react vue django
Salaria Dinesh🇮�... @SalariaDinesh
18 Followers 98 Following I still don’t understand Twitter, but here I am.
SATWIK ARNAV @SatwikArnav
26 Followers 244 Following I program | pupil at codeforces| Indie game Dev
Quantum Proxies @QuantumProxy
2 Followers 47 Following Building proxy infrastructure for web scraping & automation. Residential proxies • Rotating IPs • Global coverage https://t.co/sRARkQWIvc
Scuto @scutodev
0 Followers 16 Following AI web scraper. GDPR-safe. Extract structured data from any website in seconds.
Danish Shahzad @iMDanishShahzad
0 Followers 31 Following
zknight @zknight_ds
136 Followers 311 Following
Priyanuz Khargharia @PriyanuzK66987
6 Followers 128 Following
Florian @find_champions
0 Followers 11 Following
Phillip Lord @philliplord1
16K Followers 14K Following CEO of https://t.co/HyUViCqs0W $8105.T 🇯🇵 ALL IN
Martin Petrov @pcinews
10 Followers 197 Following
Luis Calderon @mrluiscalderon
1K Followers 2K Following Personal ying to my busines yang on life, products and tech. (FinTech, Weekend Athlete, Family, Fatherhood, Startups, Product Management)
Damon P. Anderson @DPAnderson
2K Followers 4K Following CIO, business owner, presenter, advocate, and musician who loves LIFE, family, friends, my pups, being outdoors with the great I AM and making dreams come true!
Ryan Orr @RyanOrr2020
315 Followers 169 Following Engineering @Stanford @UBC. Living in SE Asia for 2024.
Quantum__dev @Quantum__dev
4 Followers 37 Following Building AI-powered systems | Django | Machine Learning Currently working on something Healthcare related | Studying at SQI College of ICT
SankarSR7 @imsankarr7
380 Followers 5K Following Rasipuram | Self Learning AI & Data Science • Graphic Designer | DMK Supporter | Data-driven insights on TN Politics, Development & Justice | Views personal
Karolis Stasiuleviciu... @staskarolis
6 Followers 21 Following
ScrapeDrive @ScrapeDrive
1 Followers 46 Following Web scraping infrastructure for developers. We manage the anti-bot detection, CAPTCHAs, and retries so you can focus on the data.
大大 @wpf72281
0 Followers 4 Following
Victor Braga @VictorB64723
1 Followers 50 Following Developer • SaaS Builder • AI | API’s | RAG 1. https://t.co/o2KSASteWH
Adrián Valverde @adrianv_ai
13 Followers 156 Following Building invisible infrastructure behind intelligent decisions. Systems, Scale & Signals
fehim abdelfettah @fehimabdelfetah
4 Followers 346 Following
xy Re @xyRe1011579
0 Followers 44 Following
Viktoriia Hudyma @_VH_Tori
1 Followers 6 Following
PS @Panorama_123
57 Followers 1K Following Explore the wonders of universe with me! Astronomer and space enthusiast sharing fascinating facts, latest discoveries, and stargazing tips.
Dario Bahena @Radioman758274
0 Followers 35 Following
jkla562 @jkla562
20 Followers 135 Following
Shoukat Ali @techsavymind
0 Followers 61 Following
九十岁糖果超甜 @guanfeiyue
0 Followers 5 Following
Chell @MitchHewens
31 Followers 617 Following Aspiring entrepreneur. Learning everyday and looking for like minding people. Interests: - Trends and market research - Cutting-edge technology
Rodolpho Gurgel @rodolphogurgel
529 Followers 5K Following
Efluca @Efluca485
107 Followers 5K Following
crawlshift @crawlshift
0 Followers 13 Following Developer focused on data extraction, automation and API development
Joe0x ⚡️ @Joe0x_
158 Followers 643 Following Living on-chain | Web3 Developer | Smart contract research
البلائسي تا... @Kareem_Fouad
1K Followers 1K Following Sometimes the choices are limited! #Supply_Chain is my work #Zamalek is my team @zscofficial 🏹🇦🇹 #Family 1st.
Angel Munoz @digitalstoik
2K Followers 1K Following I love life, technology, health and eco-conscious lifestyle. #Productivity #Crossfit #OnlineMarketing #seo #socialmedia & #wiseinventions are my delight.
Zyte @zytedata
4K Followers 300 Following The Web Scraping API built to reduce cost, increase accuracy and make devs faster.
SeeJay @seejay
1K Followers 97 Following TechGeek, Blogger, Podcaster and Software Developer. Views are my own, @ZyteData wishes it had them.
Hacktoberfest @hacktoberfest
33K Followers 16 Following The official account for Hacktoberfest by DigitalOcean. 👾
Daniel Graña @dangrairo
349 Followers 345 Following Pragmatic Life Developer, Father, @ScrapyProject co-author. Working at @flydotio.
Pablo Hoffman @PabloHoffman
1K Followers 415 Following @Scrapinghub / @zytedata founder, @ScrapyProject creator, hacker, father, entrepreneurTrends for United States
You might like
