Overview
The news tracker has two parts:
- Cloudflare Worker — A serverless function that fetches headlines from all sources and returns combined results as JSON
- HTML Frontend — Displays the headlines and allows filtering by source
When you load the page, it calls the Cloudflare Worker API, which fetches headlines from all six sources in parallel, combines them, sorts by date, and returns the results.
How Headlines Are Extracted
ESG Today
Direct RSS FeedESG Today provides a standard RSS feed. The worker fetches the XML directly and extracts headlines from <title> tags, publication dates from <pubDate> tags, and links from <link> tags.
This is the simplest and most reliable method.
Axios Energy & Climate
Google News ProxyUses Google News RSS search to find Axios articles about energy and climate. Filters results where the source contains "axios" and cleans headlines to remove the " - Axios" suffix.
Bloomberg Green
Google News ProxyBloomberg has aggressive anti-scraping measures and no public RSS feed. We use Google News RSS search to find Bloomberg climate and energy articles. The worker filters items where the source tag contains "bloomberg" and cleans headlines to remove the " - Bloomberg" suffix.
Reuters Sustainability
Google News ProxyReuters discontinued their public RSS feeds. Same approach as Bloomberg: uses Google News RSS search to find sustainability, climate, and energy transition articles. Filters for items where the source contains "reuters".
Wall Street Journal
Google News ProxyUses Google News RSS search with specific phrases like "climate change", "carbon emissions", "renewable energy", and "net zero" to find relevant WSJ articles while filtering out general business coverage.
Heatmap
Google News ProxyUses Google News RSS search to find Heatmap articles. Since Heatmap is entirely climate/energy focused, no keyword filtering is needed — all results are included.
Summary
| Source | Method | Reliability |
|---|---|---|
| ESG Today | RSS Feed | High |
| Axios | Google News Proxy | Medium |
| Bloomberg | Google News Proxy | Medium |
| Reuters | Google News Proxy | Medium |
| WSJ | Google News Proxy | Medium |
| Heatmap | Google News Proxy | Medium |
Troubleshooting
Source shows red error dot: The feed URL may have changed, the site may be blocking requests, or for scraped sites, the page structure may have changed.
Headlines include extra text: The scraper pattern may be too broad. Adjust the title extraction logic in the relevant scraper function.
No headlines from a Google News proxy source: Google may not have indexed recent articles. Try adjusting the search query terms.