twittxr
v0.8.0
Published
Extract information from Twitter using the Syndication API.
Maintainers
Readme
Twittxr
A simple wrapper library around the Twitter/X Syndication API. Inspired by: https://github.com/zedeus/nitter/issues/919#issuecomment-1616703690
Overview
As you may know, Twitter/X ended free access to its API, making IFTTT and other services obsolete for many users. Instead, this wrapper aims to use the public facing Syndication API which is used by embedded widgets, though there are some notable limitations by using it as an "alternative".
Twittxr is best suited for setting up a user feed or getting a single tweet, it will not replace a fully fledged scraper/client.
✅ Features
- Can include retweets and/or replies by the user.
- Option to pass cookie object or string to get Sensitive/NSFW Tweets.
- Ability to pass a Puppeteer page, bypassing potential API auth issues.
- Works in and out of Node by using the fast
requestmethod from Undici, falling back to nativefetchin the browser. - Intuitive syntax and included type definitions.
❌ Limitations
- When getting a Timeline, only up to
100Tweets can be returned. (May be20in some cases)
Authentication
Twitter is now known to require a cookie to return any data!
I strongly advise you pass the cookie parameter in all of your requests.
How do I get my session cookie?
Click here -> Right click -> Inspect Element
Refresh the page -> Select the Network tab -> Find the request with the
documenttype.Under Request Headers, locate the key named
Cookieand copy the whole string.Store this in an
.envfile like so:TWITTER_COOKIE="yourCookieStringHere"
Installation
bun add twittxrOptionally, you can install puppeteer >=16 to use as a fallback on failed requests.
This can potentially avoid issues with Cloudflare. Ex: "403 Forbidden".
bun add twittxr puppeteerUsage
import { Timeline, Tweet } from 'twittxr' // ESM
const { Timeline, Tweet } = require('twittxr') // CommonJSGet a single Tweet
// Does not return the same type as Timeline.get()
const tweet = await Tweet.get('1674865731136020505')Get a user Timeline
// The retweets and replies default to false.
const cookie = process.env.TWITTER_COOKIE
const timelineWithRts = await Timeline.get('elonmusk', { cookie }, {
retweets: true,
replies: false, // This is the user's replies, not replies to their Tweets.
})Using Puppeteer
Note By default, Puppeteer will be used as a fallback for failed requests - if installed. However, it is possible to solely use Puppeteer by calling
await usePuppeteer().
import { Timeline } from 'twittxr'// Launches a basic headless browser & automatically closes the page.
await Timeline.usePuppeteer()
const tweets = await Timeline.get('elonmusk', {
cookie: process.env.TWITTER_COOKIE
})const puppeteer = require('puppeteer-extra')
// Use plugins if desired
puppeteer.use(ExamplePlugin())
const browser = await puppeteer.launch({ headless: true })
// Creates a new page and closes it automatically after every .get() call
await Timeline.usePuppeteer({ browser, autoClose: true })
const tweets = await Timeline.get('elonmusk', {
cookie: process.env.TWITTER_COOKIE
})const puppeteer = require('puppeteer')
const browser = await puppeteer.launch({ headless: true })
const page = await browser.newPage()
// Pass the page, but do not automatically close it.
await Timeline.usePuppeteer({ page, autoClose: false })
const tweets = await Timeline.get('elonmusk', {
cookie: process.env.TWITTER_COOKIE
})
await page.goto('https://google.com') // Continue to manipulate the page.
await page.close() // Close the page manually.To stop using Puppeteer at any point, you can simply call:
Timeline.disablePuppeteer()Disclaimer
You must use this library at your own discretion!
I will not be held accountable for any outcomes that may result from its usage, including and not limited to:
- Banning/Suspension of your Twitter/X account.
- Lawsuits, fines and other Twitter/X related legal disputes.
- Hacking of network and/or account when providing a proxy or exposing cookies.
