Perplexity 被 Cloudflare 點名偷抓網頁內容，偽裝 Chrome 已非初犯
去年曾被 Wired 等多家媒體指責擅用內容的 Perplexity 日前又被 Cloudflare 抓包，稱其不顧反爬蟲規則，偷偷偽裝成 Chrome 瀏覽器擷取受限網頁資料。先前 Cloudflare 的多家客戶反映自己明明已在 robots.txt 檔案（類似拒絕爬蟲的「君子協定」）和 WAF（防火牆）中將 Perplexity 的兩個官方爬蟲 PerplexityBot 及 Perplexity-User 拒之門外，但內容卻仍被 Perplexity 獲取並呈現在其搜尋結果中。
為了驗證客戶的投訴，Cloudflare 直接註冊了多個全新網域，並為其設下了全面禁止爬蟲的規則。但在如此嚴格限制下，當 Cloudflare 向 Perplexity 詢問關於這些從未在任何地方公開過的測試網域時，卻仍從 AI 那裡得到了詳細的資訊。經過深入分析後，Cloudflare 總結出了 Perplexity 所用的手法。偷抓內容的爬蟲會將自己的用戶代理（User Agent）偽裝成在 macOS 上使用 Chrome 瀏覽器的普通使用者，這樣它便能繞過封鎖混入正常的用家流量之中。
Cloudflare
根據 Cloudflare 的統計，該爬蟲每天會向全球網站發送多達 600 萬次請求，而且過程中還會不斷切換不在 Perplexity 公開列表內的 IP 甚至 ASN。面對 Perplexity 如此踐踏基本信任機制的行為，Cloudflare 最終做出了撤銷其「已驗證機器人」資格的決定，並將加推新規則進一步封鎖 Perplexity 的爬蟲。
對於 Cloudflare 的指責，Perplexity 發言人 Jesse Dwyer 辯稱對方貼出的圖片「顯示並未擷取到任何內容」。後來他更表示爬蟲「甚至不是 Perplexity 的」，並直言這一切完全是 Cloudflare 的「行銷手段」。值得一提的是，在 Cloudflare 的文章中過去也遭到過不少批評的 OpenAI 竟然被立為了遵守規則的正面典範。後者的爬蟲機器人在遇到 Cloudflare 的「釣魚執法」實驗時立即停止了抓取，還真是沒有對比就沒有傷害呢。
緊貼最新科技資訊、網購優惠，追隨 Yahoo Tech 各大社交平台！
🎉📱 Tech Facebook：https://www.facebook.com/yahootechhk
🎉📱 Tech Instagram：https://www.instagram.com/yahootechhk/
🎉📱 Tech WhatsApp 社群：https://chat.whatsapp.com/Dg3fiiyYf3yG2mgts4Mii8
🎉📱 Tech WhatsApp 頻道：https://whatsapp.com/channel/0029Va91dmR545urVCpQwq2D
🎉📱 Tech Telegram 頻道：https://t.me/yahootechhk
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
The Verge
15 minutes ago
- The Verge
A researcher scraped almost 100,000 ChatGPT conversations from Google Search.
Posted Aug 5, 2025 at 3:41 PM UTC A researcher scraped almost 100,000 ChatGPT conversations from Google Search. The conversations stemmed from a now-defunct feature that let ChatGPT users make their conversations discoverable on search engines. Some of the conversations uncovered by the researcher involved an upload of a supposed non-disclosure agreement for visitors to OpenAI's headquarters, and the owner of a named business asking ChatGPT for help writing a contract, as reported by 404 Media . Nearly 100,000 ChatGPT Conversations Were Searchable on Google [ Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates. Emma Roth Posts from this author will be added to your daily email digest and your homepage feed. See All by Emma Roth Posts from this topic will be added to your daily email digest and your homepage feed. See All AI Posts from this topic will be added to your daily email digest and your homepage feed. See All News Posts from this topic will be added to your daily email digest and your homepage feed. See All OpenAI
TechCrunch
44 minutes ago
- TechCrunch
Three weeks after acquiring Windsurf, Cognition offers staff the exit door
Cognition, the AI coding startup that acquired rival company Windsurf three weeks ago, laid off 30 employees last week and is offering buyouts to the roughly 200 remaining employees on the team, reports The Information. This is the latest bout of whiplash that Windsurf employees have faced after a tumultuous stretch for the company. The startup was initially almost acquired by OpenAI, then lost its CEO, co-founder, and research leads to Google in a $2.4 billion deal known as a reverse-acquihire (where Google hired the key talent rather than buying the company), before ultimately getting acquired by Cognition. At the time of the acquisition, Cognition stated that 100% of Windsurf employees would receive financial compensation as part of the deal and stressed that the company was excited to bring on Windsurf's 'world-class people' to develop top-notch coding tools. Now, it's becoming clear that Windsurf's intellectual property, not its talent, was the real buy. According to an email The Information viewed, employees were given until August 10 to decide whether they want to take the buyout, which amounts to nine months of salary. Those who choose to stay are reportedly required to spend six days at the office and clock 80+ hour weeks – draconian conditions that have become table stakes among workers at top AI firms. 'We don't believe in work-life balance—building the future of software engineering is a mission we all care so deeply about that we couldn't possibly separate the two,' wrote Cognition CEO Scott Wu in the email. TechCrunch has reached out to Cognition for more details.
Yahoo
an hour ago
- Yahoo
ChatGPT makers respond to growing number of people using AI as a therapist
OpenAI, the creator of ChatGPT, says it is rushing to fix the systems' difficulties with helping users in mental distress. In recent months, increasing reports have suggested that people are turning to the system as a kind of therapist, for help with personal problems and mental health issues. But ChatGPT is often overly encouraging of users who consult it, encouraging people's delusions and failing to challenge their assumptions. Now OpenAI says that it is responding to those concerns with a range of updates and research intended to help make the system less dangerous when it is used by people are experiencing mental health crises or similar problems. The company knows 'that AI can feel more responsive and personal than prior technologies, especially for vulnerable individuals experiencing mental or emotional distress', it said. Those changes include improvements to the models to make it better at recognising 'signs of delusion or emotional dependency', it said. Numerous reports have shown that the system could encourage people's delusions, or allow them to become emotionally attached to the system. Users will also now be shown alerts if they are having long sessions of sending messages to ChatGPT. The message says that it is 'just checking in' and asks whether it is a 'good time for a break'. It will also look to work through questions with people, rather than giving them an answer, especially in 'high-stakes personal decisions'. If a user asks whether they should break up with their boyfriend, for instance, it will aim to help them weigh up the decision rather than telling them what to do. OpenAI also committed to work with experts to improve the system's response at 'critical moments – for example, when someone shows signs of mental or emotional distress'. That has included working with medical experts, an advisory group on mental health and similar concerns, as well as working with researchers to improve the systems' ability to spot concerning behaviour and respond to it. The announcement comes as OpenAI continues to tease the launch of GPT-5, an update to the model that powers ChatGPT. It will be the first major release since GPT-4 was launched in 2023, and OpenAI boss Sam Altman has looked to hype the new version as potentially transformative.
