n8n-nodes-twitter-x-user-tweets

v0.0.1

Published

a month ago

This Actor provides a powerful and specific way to scrape data from Twitter (now X). It allows you to reliably extract tweets for target user profiles or handles, making it ideal for researchers, analysts, and social media tracking.

0High
0Medium
0Low

apifyxtdata

n8n-community-node-package n8n-nodes n8n

Twitter X.com User Tweets Scraper - Fast and Efficient Tweet Extraction

Key Features

Focused Input Methods: Get straightforward, exact data from users:
- Start URLs: Provide direct Twitter (X) Profile URLs and get their tweets.
- Twitter Handles: Simply list the target handles (usernames) you want to extract tweets from.
Targeted Output:
- Maximum Items: Control the maximum number of tweets retrieved for each user.
- Custom Map Function: Transform and shape the output data using a custom JavaScript function before it is saved (for data shaping, not filtering).
Built-in Concurrency & Pagination:
- Efficiently crawls and paginates through a user's timeline timeline for quick and stable extraction, utilizing Apify actors' concurrent network architecture.
Cost-Effective & Event-Driven:
- Charge for Event.

Use Cases

Market & Sentiment Research: Track recent statements and communications from specific brand or public figure profiles.
Academic Research: Gather user-centric dialogue data for social media and political science studies.
Competitive Analysis: Monitor targeted competitors' recent Twitter engagement or update feeds.
Data Archival: Regularly save out the timeline for designated profiles for record keeping.

Quick Start Examples

Here are some example input configurations to get you started quickly:

Fetching Tweets from Multiple Specific Profiles (e.g., NASA and Elon Musk):

{
	"startUrls": [
		"https://twitter.com/apify",
		"https://twitter.com/elonmusk"
	],
	"twitterHandles": [
		"taylorswift13",
		"nasa"
	],
	"maxItems": 50,
	"customMapFunction": "(object) => { return {...object} }"
}

Explanation of Key Input Fields

startUrls: An array of explicit profile URLs you want to scrape (e.g. https://twitter.com/elonmusk). Only Profile URLs are supported by this specific Actor approach.
twitterHandles: An array of raw usernames (handles) for Twitter targets if you prefer not to use full URLs.
maxItems: An integer limiting the maximum number of paginated output items for each target.
customMapFunction: Execute raw javascript logic to mutate or adjust the parsed tweet Object right before it is pushed to the Actor storage. Caution: improper functions may break output data shape.

Usage Guidelines (Important!)

Data Limits: Ensure you understand the event limit configuration of the actor as it runs in pay-per-result (or similar) mode.
Respect Twitter's Terms of Service: Always use this tool ethically and responsibly.
Concurrent Batches: If passing many URLs or Handles, the Actor natively parallelizes requests. Make sure memory settings can accommodate heavy payload iterations.

Ethical Use and Data Practices

Our 'actor' operates without logging in to X.com. This means it does not implicitly accept any Terms of Service (ToS) that require a login, as we only process data that is publicly displayed and accessible to everyone without authentication.

We are fully committed to the principle of privacy by design and by default. All data collected explicitly excludes sensitive personal information or non-public data.

Furthermore, our actor runs on Apify, an EU-based company, which means our operations are designed to be compliant with relevant EU data protection regulations, including GDPR, where applicable. You can find more information about the legality of web scraping on Apify's blog: https://blog.apify.com/is-web-scraping-legal/

We have implemented robust technical measures to ensure the actor operates gently and does not impose an undue burden on X.com's servers. Our sole purpose is to facilitate responsible research and public data analysis, and we strictly prohibit any use that could cause harm to any party or the platform itself.

Output Example

[
	{
		"id": "2029985250512920743",
		"url": "https://x.com/OpenAI/status/2029985250512920743",
		"twitterUrl": "https://twitter.com/OpenAI/status/2029985250512920743",
		"author": {
			"advertiser_account_service_levels": [
				"dso",
				"dso",
				"dso",
				"dso",
				"dso",
				"analytics"
			],
			"advertiser_account_type": "promotable_user",
			"analytics_type": "enabled",
			"blocked_by": false,
			"blocking": false,
			"can_dm": false,
			"can_media_tag": true,
			"created_at": "Sun Dec 06 22:51:08 +0000 2015",
			"description": "OpenAI’s mission is to ensure that artificial general intelligence benefits all of humanity. We’re hiring: https://t.co/dJGr6LgzPA",
			"entities": {
				"description": {
					"hashtags": [],
					"symbols": [],
					"urls": [
						{
							"display_url": "openai.com/jobs",
							"expanded_url": "http://openai.com/jobs",
							"indices": [
								107,
								130
							],
							"url": "https://t.co/dJGr6LgzPA"
						}
					],
					"user_mentions": []
				},
				"url": {
					"urls": [
						{
							"display_url": "openai.com",
							"expanded_url": "https://openai.com",
							"indices": [
								0,
								23
							],
							"url": "https://t.co/3bPlZZkvdL"
						}
					]
				}
			},
			"fast_followers_count": 0,
			"favourites_count": 1756,
			"follow_request_sent": false,
			"followed_by": false,
			"followers_count": 4671709,
			"following": false,
			"friends_count": 4,
			"geo_enabled": false,
			"has_custom_timelines": false,
			"has_extended_profile": false,
			"id_str": "4398626122",
			"is_translator": false,
			"location": "",
			"media_count": 522,
			"muting": false,
			"name": "OpenAI",
			"normal_followers_count": 4671709,
			"notifications": false,
			"pinned_tweet_ids_str": [
				"2029620619743219811"
			],
			"profile_background_color": "C0DEED",
			"profile_banner_url": "https://pbs.twimg.com/profile_banners/4398626122/1770318871",
			"profile_image_url_https": "https://pbs.twimg.com/profile_images/1885410181409820672/ztsaR0JW_normal.jpg",
			"profile_interstitial_type": "",
			"profile_link_color": "1DA1F2",
			"protected": false,
			"screen_name": "OpenAI",
			"statuses_count": 1712,
			"translator_type_enum": "None",
			"url": "https://t.co/3bPlZZkvdL",
			"verified": false,
			"verified_type": "Business",
			"want_retweets": false,
			"withheld_in_countries": []
		},
		"full_text": "Codex Security—our application security agent—is now in research preview.\n\nhttps://t.co/JG2uwGUJFv",
		"favorite_count": 2522,
		"retweet_count": 245,
		"reply_count": 310,
		"quote_count": 137,
		"bookmark_count": 745,
		"bookmarked": false,
		"conversation_id_str": "2029985250512920743",
		"created_at": "Fri Mar 06 18:19:33 +0000 2026",
		"display_text_range": [
			0,
			98
		],
		"entities": {
			"hashtags": [],
			"symbols": [],
			"timestamps": [],
			"urls": [
				{
					"display_url": "openai.com/index/codex-se…",
					"expanded_url": "https://openai.com/index/codex-security-now-in-research-preview/",
					"indices": [
						75,
						98
					],
					"url": "https://t.co/JG2uwGUJFv"
				}
			],
			"user_mentions": []
		},
		"favorited": false,
		"is_quote_status": false,
		"lang": "en",
		"possibly_sensitive": false,
		"possibly_sensitive_editable": true,
		"retweeted": false,
		"user_id_str": "4398626122"
	}
]

Troubleshooting

If you encounter issues like early termination, check if your Apify workspace event allocation limits were breached. Be sure that startUrls specifically links to direct user profiles rather than general search pages, as this Actor is specialized for user timelines.

Get Started

Start scraping Twitter data today! This Actor provides a powerful, flexible, and cost-effective solution for targeted user data extraction needs.

1. TikTok Actors

2. X.com (Twitter) Actors

| | | | |---------------------------------------------------------------------------------------|-----------------------------------------------------------------------------------------------------------|-----------------------------------------------------------------------------------------------------------| | 🐦 X.com Twitter API Scraper | 🐦 X.com Twitter User Tweets Scraper | 🐦 X.com Twitter User Tweets Scraper |

3. YouTube Actors

| | | | |---------------------------------------------------------------------------------------|--|--| | 📜 YouTube Transcript API | | |