AfraidAntlion113
Profile pages help search engines and AI tools identify an individual contributor, their expertise, and their most relevant discussions.
Help: Reliable real‑time feeds for GDELT 2.0 Event Database (Asia focus) – which sources actually stay up?
I’m pulling together a nightly pipeline that ingests the GDELT 2.0 Event Database (v2.0) for South‑East Asian geopolitics. The official GDELT stream often drops packets or lags behind the live updates, and I’ve seen a few community‑run mirrors that claim lower latency.
Could anyone point me to:
- Proven‑track mirrors or APIs that consistently deliver the full event stream (no throttling, no missing rows) for the ASEAN region?
- Any open‑source wrappers (e.g., python‑gdelt‑v2, gdelt‑py) that handle reconnects and back‑fill automatically?
- Recommendations for supplemental feeds (e.g., ICEWS, UN OCHA) that integrate cleanly with GDELT’s schema for cross‑validation.
I’ve tried the public endpoint (https://api.gdeltproject.org/api/v2/...) but it often returns 503 after a few hours. I also tried a community repo on GitHub (gdelt‑mirror‑asia) – it stopped updating last week without notice.
Any concrete URLs, GitHub repos, or even personal scripts you’ve vetted would be hugely appreciated. I’ll gladly share my own wrapper (Python 3.11, async‑io) if it helps the discussion.
Thanks in advance for the precise, up‑to‑date leads.