Skip to content

Data Sources

Complete list of news sources, government databases, and social media platforms targeted for scraping.

SourceTypeScrape MethodLanguage
The HinduDaily newspaperRSSEnglish
Times of IndiaDailyRSSEnglish
The New Indian ExpressDailyRSSEnglish
DinamaniTamil dailyPlaywrightTamil
DinamalarTamil dailyRSS + PlaywrightTamil
Dina ThanthiTamil dailyPlaywrightTamil
The Hindu TamilTamil dailyRSSTamil
BBC TamilTamil newsRSSTamil
OneIndia TamilDigital newsPlaywrightTamil
ABP NaduDigital newsPlaywrightTamil
Zee News TamilTV+DigitalPlaywrightTamil
News18 TamilnaduDigitalPlaywrightTamil
Times Now TamilDigitalPlaywrightTamil
NewsTamil 24x7DigitalPlaywrightTamil
Polimer NewsTV+DigitalPlaywrightTamil
Puthiya ThalaimuraiTV+DigitalPlaywrightTamil
Thanthi TVTV+DigitalPlaywrightTamil
VikatanWeekly magazinePlaywrightTamil
SourceData TypeFormat
Tamil Nadu PoliceFIRs, press releasesWeb
TN Government (tn.gov.in)Press releasesWeb
NCRB (ncrb.gov.in)Crime statisticsCSV/PDF
National Commission for WomenCase reportsWeb
Madras High CourtJudgmentsWeb
TN Police Twitter/XReal-time alertsAPI
District AdministrationLocal newsWeb
PlatformData TypeMethod
YouTubeTamil news channelsData API + transcript
Twitter/XTrends, breaking newsAPI
FacebookCommunity pagesPublic scraping
TelegramTN news channelsPublic channel scraping
ChannelFocusLanguage
NewsTamil 24x7Breaking TN newsTamil
BBC TamilIn-depth analysisTamil
Vikatan TVInvestigationsTamil
Polimer NewsRural TNTamil
Thanthi TVCrime, politicsTamil
Puthiya ThalaimuraiTN politicsTamil
ABP NaduDigital-firstTamil

RSS feeds from 5 major sources + YouTube transcripts

All news publications + government sources

Social media + full YouTube channel coverage