What does Reddit Scraper do?
Reddit is where unfiltered product feedback, niche expertise, and early trends show up first. The official API is useful for some products, but many research and marketing teams just need public threads in a spreadsheet. ScrapeHub’s Reddit Scraper reads public pages for you, runs the job in the cloud, and returns structured rows you can filter, join, or feed into downstream tools.
Reddit Scraper allows you to:
- Crawl public subreddits end to end — Collect Hot, New, Top, or Rising posts from any open community — including titles, scores, authors, flair, and comment counts.
- Capture full comment conversations — Pull comment bodies, scores, timestamps, and parent relationships so you can reconstruct threads for research or sentiment work.
- Profile creators and power users — Export usernames, karma, account age, and recent activity when you are mapping who drives a discussion.
- Search by keyword when you do not have a URL yet — Start from a topic (“AI coding tools”, “churned Salesforce”) and let the scraper gather matching posts across Reddit.
- Control depth before you spend credits — Cap posts, comments, and users in the form so exploratory runs stay cheap and production runs stay predictable.
- Export for humans and pipelines — Download CSV for analysts, JSON for engineers, or forward finished runs via API/webhook when you automate monitoring.
What data can I extract from Reddit?
| Posts |
|---|
| Title and text |
| Author username |
| Score / upvotes |
| Number of comments |
| Media (images, video) |
| Post URL |
| Flair |
| NSFW flag |
| Comments |
|---|
| Comment body |
| Author username |
| Score / upvotes |
| Timestamp |
| Reply count |
| Comment and post URL |
| Parent comment ID |
| Subreddits |
|---|
| Name and URL |
| Member count |
| Description |
| Category |
| Creation date |
| Users |
|---|
| Username |
| Post karma / comment karma |
| Account creation date |
| Recent posts and comments |
| Profile description |
How much will it cost?
A focused Reddit pull usually lands around $1.20 per 1,000 delivered rows on pay-as-you-go — whether those rows are posts, comments, or profiles.
Credits never expire while your account is active, and you are not charged for failed deliveries. Buy a larger pack when monitoring becomes a weekly habit.
How to scrape Reddit
Reddit Scraper doesn't require any coding skills to start.
- Create a free ScrapeHub account with your email.
- Open Reddit Scraper from the scrapers list in your dashboard.
- Paste subreddit, post, or profile URLs — or type a search term if you are still exploring a topic.
- Set sort/time filters and max limits so the job matches the question you are asking, then click Start.
- When the run finishes, download CSV/JSON or send the results into your pipeline via API/webhook.
How to use scraped Reddit data
- Brand and community teams track product mentions across niche subreddits before issues hit Twitter.
- Researchers gather opinionated threads on finance, health, or tech without copying posts by hand.
- PMs mine comment objections and feature requests phrased in customer language.
- Agencies watch competitors’ launches and the threads that form around them.
- Data teams build training or RAG corpora from public discussions with stable field names.
- Founders validate problems by searching pain-point keywords and exporting the loudest threads.
What you configure in the dashboard
Every run is a form, not a script. Tell the scraper which Reddit pages or topics to cover, set limits that match your budget, and click Start — no JSON required.
Paste the Reddit pages you already care about — a subreddit, a single post, a user profile, or a search results link. Use this when you know exactly where the conversation lives.
Type a topic when you do not have URLs yet. The scraper searches public Reddit content for that phrase so you can discover threads instead of hunting them manually.
Optional. Restrict keyword search to one subreddit when you only want signal from a specific community (for example, only r/SaaS).
Choose how Reddit should order results — Relevance, Hot, Top, New, or Comments — depending on whether you want freshness or popularity.
Limit posts to the last hour, day, week, month, year, or all time. Essential for recurring monitors so each run does not re-pull ancient history.
Decide whether adult-tagged communities and posts belong in this dataset. Default to off unless the research explicitly needs them.
Enable when you need richer engagement and media URLs. Leave off for faster, cheaper text-first exports.
Hard caps that protect your credit balance. Start small while you validate field quality, then raise limits for production monitors.
Example setups from real workflows
Topic discovery: “parrots” with media fields
You are exploring a niche and want a compact sample of posts plus media metadata — not a full comment dump yet.
- Search term
- parrots
- Include media details
- On
- Max posts
- 10
Community watch: r/pasta new posts + light comments
Paste the subreddit, sort by New, and keep comment depth modest so you catch fresh threads without burning credits on every reply.
- Start URLs
- reddit.com/r/pasta/
- Sort
- New
- Max posts
- 50
- Max comments
- 20
Supported URL types
| Type | Example |
|---|---|
| Community | reddit.com/r/worldnews/ |
| Community sorted | reddit.com/r/worldnews/hot |
| User profile | reddit.com/user/username |
| User comments | reddit.com/user/username/comments/ |
| Specific post | reddit.com/r/.../comments/.../post_title/ |
| Search results | reddit.com/search/?q=news |
Structured results
After the run finishes, download JSON/CSV from the dashboard — or send results via API/webhook. Each post, comment, user, or community is a separate row. Turn on “Include media details” in the form when you need richer media and engagement fields.
{
"id": "1abc23",
"title": "Best AI tools for developers",
"author": "johndoe",
"subreddit": "ChatGPT",
"score": 1542,
"numberOfComments": 387,
"createdAt": "2026-06-27T12:30:15Z",
"url": "https://reddit.com/r/ChatGPT/comments/1abc23/...",
"nsfw": false,
"imageUrls": [],
"videoUrls": []
}Tips
Reddit's 1,000-item limit
Any list on Reddit (a subreddit's “New” posts, search results) stops at roughly 1,000 items — this is a Reddit platform limitation, not a limitation of the scraper. It does notaffect comments: a single post's full comment thread can still be extracted in full, even with thousands of comments.
To collect more than 1,000 items from a list:
- Combine sorts— scrape “New”, then “Top”, “Hot”, and “Controversial” separately to surface different subsets.
- Use search — keyword search often surfaces older posts no longer visible in standard lists.
- Use time filters— “last year”, “last month”, etc. reveal different result sets.
- Use date limits — set post/comment date limits in the dashboard for incremental daily scraping before items fall off the 1,000 cap.
Controlling job size and cost
Use the Max posts / comments / users fields in the dashboard to cap a job's size — useful for controlling credit spend and preventing runaway runs.
Pricing
| Plan | Price | Included |
|---|---|---|
| Free | $0 | Trial credits to validate a sample export |
| Pay-as-you-go | from ~$1.20 / 1,000 results | Shared credits; API and webhooks available |
| Business | Custom | Volume pricing, SLA, priority support |
Reddit API vs ScrapeHub
| Official Reddit API | ScrapeHub | |
|---|---|---|
| Setup | OAuth app registration and ongoing token management | Email signup and a dashboard form |
| Rate limits | Strict request budgets that punish exploratory research | Managed infra; you control spend with job limits |
| Cost model | API access has become paid/restricted for many use cases | Pay only for successfully delivered rows |
| Who it fits | Products that need deep first-party Reddit integrations | Researchers and marketers who need public exports now |
| Auth for public read data | Required for the official API | Not required for public page extraction |
FAQ
- Do I need the Reddit API?
- No. If your goal is public posts and comments in a structured file, ScrapeHub extracts that without OAuth credentials or a Reddit developer app.
- Is scraping Reddit legal?
- Collecting publicly visible Reddit content is common for research and analytics. You remain responsible for Reddit’s terms and for how you store or republish anything that includes personal data.
- Do I need to log in with a Reddit account?
- No. Public pages do not require your Reddit login, and ScrapeHub does not ask for cookies or passwords.
- Do you handle proxies?
- Yes. Rotation and request balancing are part of the managed run — you do not buy proxy lists or wire them into a script.
- Why do subreddit feeds stop around 1,000 posts?
- That ceiling comes from Reddit’s own listing behavior, not from an artificial ScrapeHub cap. Use different sorts, time ranges, and searches to surface other slices — see Tips above.
- Can I still get thousands of comments on one post?
- Yes. The ~1,000-item limit applies to feeds and search lists, not to digging through comments under a single post.
- How much does Reddit scraping cost?
- You pay for delivered rows on pay-as-you-go — typically around $1.20 per 1,000 results. Trial credits on free accounts let you inspect quality first.
- What can I export?
- JSON and CSV from the dashboard on every plan. API and webhook delivery are available when you automate. Excel/XML can be arranged for business needs.
- How fast are jobs?
- Many 1,000–5,000 row runs finish in a few minutes. Larger comment crawls take longer in proportion to depth and concurrency.
- Can I connect this to n8n or Make?
- Yes. Trigger runs and pull results through the API, then map fields into your workflow nodes like any other HTTP source.
- Will deleted posts appear?
- No. Only content that is still publicly available is returned. Removed or deleted items simply will not show up.
- What about private or banned subreddits?
- If Reddit will not show the community to a logged-out visitor, the scraper cannot return it either.
- Can I use exports for AI training?
- Structured JSON/CSV is compatible with fine-tuning and RAG pipelines. You still need to respect licenses, ToS, and privacy obligations for your use case.
- Can I sort by Top/Hot/New and filter by time?
- Yes — those are dashboard fields (Sort and Time range), not something you configure in code.
- Can I run thousands of URLs or keywords at once?
- Yes. Paste a large batch into the form for one job, or automate submission through the API once the sample export looks right.