Exactly that. The session ID staying alive is what makes it sneaky: your code thinks the lease held, the target sees a new IP and geo. So we re-check the exit IP on every follow-up request instead of trusting the lease. It scores as unexpected rotation, separate from a clean session drop. :)
Session reliability is the metric most "top 10 proxy" lists completely ignore.
Across the 3 residential providers I benchmark continuously:
→ Best: 97.5% sticky session survival
→ Worst: 72.2%
→ Unexpected mid-session rotation ranges 1.4% to 7.3%
If your scraper needs login flows, this is THE number to compare.
#ResidentialProxy#WebScraping
Live data: proxystats.io/dashboard
Methodology: proxystats.io/methodology
Why it matters: a provider can advertise "99% uptime" and still rotate your IP mid-session 7% of the time — breaking every stateful workflow. Aggregate uptime hides it.
3 months benchmarking residential proxies. 400K probes. 3 providers.
The cheapest ($0.30/GB) scores HIGHEST.
The fastest (10.78 Mbps) scores LOWEST.
"You get what you pay for" doesn't hold in this market.
#ResidentialProxy#WebScraping
@hasantoxr crawlee good. the 'never get blocked' part is misleading though. library rotates whatever pool you bring. cheap pool rotates through 100 flagged IPs, you still get blocked on the 101st
🚨 I just found a 100% open-source Python web scraping library that makes you basically invisible to bot detection.
It's called Crawlee.
Build reliable crawlers that fly under the radar of every modern anti-bot system.
What it does:
→ Scrapes any website with BeautifulSoup, Playwright, or raw HTTP your choice
→ Auto-rotates proxies and manages sessions so you never get blocked
→ Handles JS-heavy sites with full headless browser support
→ Parallel crawling that scales automatically with your system resources
→ Saves data to persistent storage no lost progress if something crashes
→ Retries failed requests automatically without you touching anything
One pip install.
Works on any site. Any format. HTML, PDF, JPG, PNG all of it.
8.1K stars. 100% Opensource. Apache 2.0 License.
(Link in the comments)
Stealth fetcher + proxy rotation is the killer combo, but the rotation is only as good as the pool. Been benchmarking residential providers for 3 months. p50 TTFB across top 3 ranges 440ms to 800ms, and one provider's DE pool sits at <15% session survival for weeks straight. Once you're past Cloudflare, framework choice matters less than what's feeding it.
Holy shit.
Now everyone will be able to use their @openclaws and all the other agentic platforms to build apps on top of X.
Here's the secret: build lists.
Lists are how you build apps.
The pattern:
Build a list of your favorite football team. Or whatever you are into.
Most of what we call "novel" vulnerability research is just _creative recombination within a known search space_. And creative recombination within large known search spaces is what these frontier models will get ridiculously good at.
An IP is flagged as a residential proxy. Now what?
The classification is just the starting point.
percent_days_seen and last_seen add the time-based context needed to understand behavior, whether it’s new, active, or inactive.
Explore the data: ipinfo.io/data/residenti…#ProxyDetection#NetworkData#Cybersecurity
Built a bot. Didn’t expect much.
$200 → $43,103 later… I had to double check the logs.
Day 1:
12 trades
$4,601 profit
What it actually does:
Copytrade → t.me/KreoPolyBot?st…
* Tracks and copy trades the 4 most profitable wallets
* Snipes pumps before they become obvious
* Parses news faster than humans can react
* Arbitrages spreads between prediction markets
It’s basically running 4 strategies at once.
And the craziest part — I don’t even touch it.
It runs autonomously and just pings me when it makes moves.
All built with a $20 Claude subscription.
Thinking about open-sourcing it. Curious if anyone wants access.
The Senior Machine Learning Modeler at Block will develop batch and real-time ML solutions for assessing financial crime risk. Responsibilities include collaborating with stakeholders, documenting the program, leading ML best practices, and continuously improving processes to enhance investigator productivity.
Block is one company built from many blocks, all united by the same purpose of economic empowerment. The blocks that form our foundational teams - People, Finance, Counsel, Hardware, Information Security, Platform Infrastructure Engineering, and more - provide support and guidance at the corporate level. They work across business groups and around the globe, spanning time zones and disciplines to develop inclusive People policies, forecast finances, give legal counsel, safeguard systems, nurture new initiatives, and more. Every challenge creates possibilities, and we need different perspectives to see them all. Bring yours to Block.
The Role
The Block Financial Crimes Machine Learning team is responsible for detecting, preventing, and reporting illegal activity across all markets in which Square and Cash App operate. We work globally with partners in business, engineering, counsel, and product to ensure we are providing a safe user experience for our customers while minimizing or eliminating bad activity on our platform.
We leverage Machine Learning as an integral part of our toolkit to fulfill our mission. We employ scalable solutions in order to monitor billions of dollars in transactions. We uncover and put an end to money laundering, terrorist financing, and other illegal activities before they impact our users. Additionally, we improve workflow and case tools, adding features that empower investigator productivity and automate the high volume of monitoring. We are looking for Senior Machine Learning Modelers who are interested in solving critical business problems using any and all tools necessary.
You Will
Build both batch and real-time machine learning solutions for the assessment of financial crimes risk at scale across all global markets in which Square and Cash App operate
Work closely with stakeholders, business partners, and product engineering teams to ensure that data can be leveraged effectively to build efficient solutions within our regulatory program
Produce thorough documentation of our program that can withstand regulatory scrutiny
Proactively identify new opportunities and future needs of our ML teams
Lead by example by applying ML and engineering best practices
Stay current on ML developments in the field, foster an environment of continuous learning, and apply new learnings when applicable
Have a significant impact on influencing team culture and direction
You Have
5+ years of software engineering or machine learning experience
A degree (preferable graduate level) in Computer Science, Engineering, Statistics, Physics, Applied Math or a related technical field
An ability to maintain critical production software and build new production software from scratch
Prior experience working with product, engineering, and business to prioritize, scope, design, and deploy ML tooling and infrastructure at scale
Natural curiosity and desire to grow and help shape all aspects of our growing team
Excellent written and oral communication skills to both technical and non-technical audiences, and are comfortable working with a cross-functional, globally distributed team
We're working to build a more inclusive economy where our customers have equal access to opportunity, and we strive to live by these same values in building our workplace. Block is an equal opportunity employer evaluating all employees and job applicants without regard to identity or any legally protected class. We also consider qualified applicants with criminal histories for employment on our team, and always assess candidates on an individualized basis.
We believe in being fair, and are committed to an inclusive interview experience, including providing reasonable accommodations to disabled applicants throughout the recruitment process. We encourage applicants to share any needed accommodations with their recruiter, who will treat these requests as confidentially as possible. Want to learn more about what we're doing to build a workplace that is fair and square? Check out our I+D page.
Block will consider qualified applicants with arrest or conviction records for employment in accordance with state and local laws and "fair chance" ordinances
Block takes a market-based approach to pay, and pay may vary depending on your location. U.S. locations are categorized into one of four zones based on a cost of labor index for that geographic area. The successful candidate's starting pay will be determined based on job-related skills, experience, qualifications, work location, and market conditions. These ranges may be modified in the future.
To find a location's zone designation, please refer to this resource . If a location of interest is not listed, please speak with a recruiter for additional information.
Zone A:
$189,000 - $283,600 USD
Zone B:
$179,600 - $269,400 USD
Zone C:
$170,100 - $255,100 USD
Zone D:
$160,700 - $241,100 USD
Every benefit we offer is designed with one goal: empowering you to do the best work of your career while building the life you want. Remote work, healthcare coverage, flexible time off, and modern family planning are just some of our offerings. Check out our other benefits at Block.
Block, Inc. (NYSE: XYZ) builds technology to increase access to the global economy. Each of our brands unlocks different aspects of the economy for more people. Square makes commerce and financial services accessible to sellers. Cash App is the easy way to spend, send, and store money. Afterpay is transforming the way customers manage their spending over time. TIDAL is a music platform that empowers artists to thrive as entrepreneurs. Bitkey is a simple self-custody wallet built for bitcoin. Proto is a suite of bitcoin mining products and services. Together, we're helping build a financial system that is open to everyone.
4K Followers 7 FollowingIPRoyal's top-of-the-line proxy services enable businesses and individuals worldwide to improve their operations with unrestricted Internet access.
14K Followers 20 FollowingAll your proxy needs in one place
Data Center
Static Residential
Rotating Residential
Join our free discord for latest promos https://t.co/G0DFtsYZJq
867 Followers 1 FollowingScrapling is an adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl by @D4Vinci1
Follow for daily tips & tricks.
210K Followers 3K FollowingFollow for posts about GitHub repos, DSPy, and agents
Subscribe for top posts
DM to share your AI project (Due to volume of DMs I'll prioritize subscribers)
290 Followers 392 FollowingChristian. Ex-poker player. In IT and AI since the 2000s. Runs several businesses. Posts stopping points, not highlight reels.
22 Followers 58 FollowingI ❤️ Capital Market. Product management is 🥯. Tweets are personal & Not a recommendations . interested in gyan , come to insta @thepaisaproject
82 Followers 846 FollowingIndie dev building apps that solve real problems 📱
Creator of VoiceTimer – hands-free talking timer for Android
Building in public | SaaS & iOS coming soon 🚀
3K Followers 404 FollowingAI security R&D at @theori_io, @xint_official. LLM vuln research since 2024. Flag capturer at @PlaidCTF. Cryptography enthusiast.
12K Followers 18 Following👨💻 Penetration testing
🧑💼 Cybersecurity consulting
🎓Appsec training
🌏 Born in Australia, serving customers globally
Founded by @hakluke
254K Followers 205 FollowingBreaking cybersecurity and technology news, guides, and tutorials that help you get the most from your computer. DMs are open, so send us those tips!
87 Followers 20 FollowingIPFoxy is a global pure IP proxy service provider, offering enterprise-grade rotating and dedicated IP to efficiently support a wide range of online businesses.
9K Followers 30 FollowingIP data built for scale. Get geolocation, privacy flags, carrier data & more.
IPinfo powers smarter decisions with the world’s most trusted IP data.
500K+ users
4K Followers 3K Following$HBAR $ZBCN | ⚡️😎
Looking to buy crypto? I recommend Kraken — use my link to sign up:
https://t.co/dEIrNrgge9 Referral Code: 3kyj2hkh
3.5M Followers 2K FollowingLeading global crypto platform built on trust | 40M+ users worldwide | Support: @KuCoinUpdates | UK users: @KuCoin_UK | AU users: @kucoinaustralia
7.1M Followers 596 Following#CMC is the world’s most trusted source for crypto data & insights. Have a question about crypto? Ask https://t.co/54uUtCsuxw
3.9M Followers 3K FollowingThe high performance network powering internet capital markets, payments, AI agents, and crypto apps. Now dealing the @wsop.
4.3M Followers 0 FollowingThe universal platform for crypto, blockchain apps, stablecoins & decentralized tech. An account about the Ethereum ecosystem maintained by @ethereumfndn.
8.7M Followers 13 FollowingBitcoin is an open source censorship-resistant peer-to-peer immutable network. Trackable digital gold. Don't trust; verify. Not your keys; not your coins.